Easy Apply
Easy Apply
As a Big Data DevOps Lead, you will improve Big Data infrastructure efficiency, lead architecture efforts, and provide on-call support for production systems.
Summary:
As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.
Main Responsibilities:
• Driving improvement of the efficiency of Big Data infrastructure.
- Coordinating cross-team infrastructure and Big Data initiatives.
- Leading Big Data – related architecture and design efforts.
- Ensuring availability, efficiency, and reliability of the Big Data infrastructure.
- Building and supporting tools for operational tasks.
• Evaluating, designing, deploying monitoring tools. - Design and implementation of DR/BC practices and procedures.
- On-call support of production systems.
Requirements:
• 7+ years of experience working with Hadoop, preferably Open Source.
- 3+ years of leading Big Data, DevOps, SRE, DBA, or development team.
- Experience setting up and running Hadoop clusters of 1000+ nodes.
- Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.
- Experience running and troubleshooting Kafka.
- Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet.
• Proficiency in shell scripting.
Nice to have:
• Experience with Prometheus.
- Experience managing Showflake.
• Solid knowledge of Graphite and Grafana. - Python or Perl scripting skills.
- Experience with installing and managing Aerospike.
- DBA experience with one of: PostgreSQL, MySQL, MariaDB.
Top Skills
Aerospike
Ansible
Cassandra
Grafana
Graphite
Hadoop
Kafka
Mariadb
MySQL
NoSQL
Perl
Postgres
Prometheus
Puppet
Python
Saltstack
Scylladb
Shell Scripting
Showflake
Terraform
Similar Jobs at Zeta Global
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Principal Software Engineer will lead technical and thought innovations for product features, mentor teams, and collaborate on system infrastructure and architecture, requiring a deep expertise in software and data technologies.
Top Skills:
AerospikeApache AirflowApache LuigiAWSBashCi/CdDjangoDockerDynamoDBEmrFastapiHbaseHdfsHiveJavaKafkaKubernetesMySQLOpen Table FormatsPostgresPythonRedisScalaScyllaSnowflakeSparkTerraform
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Senior Frontend Engineer will design and implement scalable web applications, focusing on performance and user experience, while leading core component development on a marketing automation platform.
Top Skills:
AjaxApacheCSS3Es6+GoHTMLHTTPHttp2.0JavaJavaScriptNginxNode.jsPythonReactRestTypescriptWebpackWebsockets
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Senior Software Engineer will design and maintain data infrastructure, coordinate with analysts on ETL processes, and collaborate on data products while ensuring data quality and availability.
Top Skills:
AirflowAWSFastapiHivePythonSnowflakeSpark
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
