Data Engineer

WHO WE ARE

Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the market through competitive pricing, execution and risk management. By providing liquidity on multiple exchanges across the world in various financial instruments we participate in the safeguarding of healthy and efficient markets. We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products: listed derivatives, cash equities, ETFs, bonds and foreign currencies.

Optiver’s Sydney office is one of the primary players within Asian markets, trading a range of products. Established in 1996, we're an active participant on the Hong Kong, Korea, Singapore, Taiwan and Japan exchanges, and act as Optiver’s APAC head office.

WHAT YOU'LL DO

Optiver Sydney is seeking a seasoned Data Engineer to support and advance the data needs of our local research team. You’ll work closely with researchers in Sydney and our Global Research and Data Platform teams to productionise workflows, optimise large-scale data processing, and manage infrastructure costs efficiently.

This role requires deep expertise in Data Engineering concepts and technologies, along with a strong ability to work independently and deliver impactful results in a fast-paced environment. You will play a pivotal role in designing and implementing data solutions that enable efficient access to high-quality data, ensuring smooth operations of our data pipelines. Your work will directly support our research teams in deriving real-time insights and making data-driven decisions.

As a key data engineering hire in our Sydney office, you will partner with cross-functional teams across regions to enhance and align our data strategy, helping drive Optiver’s data and analytics capabilities forward. Dependent on experience and seniority, key responsibilities would include:

• Collaborate with researchers to transform experimental workflows into production-ready data pipelines that meet performance and reliability standards.
• Platform and Tooling development: Advancing the start of the art of a variety of Optiver's Research and Data Team's platforms and tools.
• Cost Optimisation: Monitor and optimise resource usage in partnership with the Data Platform team, balancing performance and cost-effectiveness.
• Monitoring & Tuning: Implement monitoring tools and fine-tune systems for optimal throughput, latency, and reliability, ensuring seamless access to data.
• Cross-Functional Collaboration: Work closely with our Data Platform teams globally, maintaining alignment on data strategy, tools, and best practices.
• Data Pipeline Design & Development: Architect, build, and manage scalable data pipelines using Spark, Databricks, and proprietary HPC tooling, ensuring high availability, scalability, and performance.
• Documentation & Standards: Develop and maintain clear documentation of data pipeline architectures, processes, and best practices.
• Mentorship & Guidance: Provide technical mentorship to junior engineers and support the growth of the data engineering function in Sydney.

WHO YOU ARE

We are looking for a highly skilled Data Engineer with:

• 3+ years of experience in data engineering.
• Demonstrable proficiency in Python
• Familiarity with distributed data processing and building robust data pipelines.
• Familiarity with the use of or concepts underpinning various Data Engineering technologies and approaches.
• Hands-on experience with Spark or Databricks highly desirable.
• Ability to lead projects autonomously, prioritise tasks, and deliver high-quality results.
• Proven success working with research and platform engineering teams to support data-driven projects.
• Strong problem-solving skills, focusing on efficiency, scalability, and cost-effectiveness.
• Excellent written and verbal communication skills, with the ability to convey technical concepts to both technical and non-technical stakeholders.
• A Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field.
• Other preferred qualifications include familiarity with cloud-based architectures (e.g. AWS), large-scale relational databases experience (e.g. PostgreSQL), knowledge of real-time data streaming technologies (e.g. Kafka), and familiarity with system languages (e.g. C++, Rust).

WHAT YOU'LL GET

You’ll join a culture of collaboration and excellence, where you’ll be surrounded by curious thinkers and creative problem solvers. Driven by a passion for continuous improvement, you’ll thrive in a supportive, high-performing environment alongside talented colleagues, working collectively to tackle some of the most complex problems in the financial markets.

In return for your expertise, you will be offered a competitive salary package as well as access to a range of Optiver perks, including:

• The chance to work alongside best-in-class professionals
• Competitive remuneration, including an attractive bonus structure and additional leave entitlements
• Training, mentorship and personal development opportunities
• Gym membership plus weekly in-house chair massages
• Daily breakfast, lunch and an in-house barista
• Regular social events including an annual company trip

Optiver is committed to diversity and inclusion, and it is hardwired through every stage of our hiring process. We encourage applications from candidates from any and all backgrounds, and we welcome requests for reasonable adjustments during the process to ensure that you can best demonstrate your abilities.

Questions? Get in touch with the recruitment team at [email protected]