APM Group Logo

APM Group

Senior Data Engineer

Sorry, this job was removed at 11:12 a.m. (AEST) on Tuesday, Nov 17, 2026
Be an Early Applicant
Hybrid
North Sydney, New South Wales, AUS
Senior level
Hybrid
North Sydney, New South Wales, AUS
Senior level

Similar Jobs

3 Days Ago
Hybrid
Sydney, New South Wales, AUS
Senior level
Senior level
Retail
Design, build, and maintain cloud-native data and application solutions using Databricks, Unity Catalog, Apache Spark, C#, Python, .NET, and GCP. Develop backend microservices, APIs, data pipelines, and infrastructure through Terraform and Azure DevOps CI/CD. Manage SQL and NoSQL storage, optimize data processing, support governance and lineage, and provide technical leadership within Agile product squads.
Top Skills: .NetAgileSparkAsp.NetAzure DevopsBigQueryC#Cloud RunDatabricksFirestoreGoogle Cloud PlatformNoSQLPythonScrumSQLTerraformUnity Catalog
12 Days Ago
Hybrid
Sydney, New South Wales, AUS
Senior level
Senior level
Payments • Financial Services
Own and evolve Shift’s Azure Databricks data platform, including engineering standards, CI/CD, testing, monitoring, governance, scalable ELT pipelines, and cost optimization. Lead the data workstream for a core lending system migration, build trusted dimensional models, improve data quality and freshness, and mentor junior engineers. Partner with analysts, data scientists, product managers, and engineering teams to deliver reliable self-service data products.
Top Skills: SparkAzure DatabricksAzure DevopsCi/CdConformed DimensionsDatabricks Asset BundlesDelta LakeDimensional ModelingEltGitMedallion ArchitecturePythonSQLStar SchemasUnity Catalog
26 Days Ago
In-Office
Sydney, New South Wales, AUS
Senior level
Senior level
Fintech • Financial Services
Design and evolve scalable, fault-tolerant ETL/ELT pipelines and real-time data systems for financial analytics. Lead Kafka and RabbitMQ stream processing, optimize ClickHouse schemas and queries, deploy secure cloud-based data services, and implement monitoring and automated recovery. Collaborate with leadership, support data governance, mentor engineers through technical guidance and code reviews, and independently develop and optimize Python and SQL pipelines handling high-throughput market and transactional data.
Top Skills: AirflowClickhouseCloud EnvironmentsEltETLKafkaPythonRabbitMQReal-Time Data ProcessingSQLStream Processing
Lead the design, development, optimization, and support of enterprise data platforms using Microsoft Fabric. Build scalable batch and near-real-time pipelines, lakehouses, warehouses, semantic models, and data transformations. Drive governance, security, performance, disaster recovery, and platform modernization while supporting production environments. Provide technical leadership, mentoring, stakeholder engagement, troubleshooting, and continuous improvement across enterprise data and analytics initiatives.
The summary above was generated by AI
Job Description

Drive enterprise data transformation with Microsoft Fabric

We are seeking a highly skilled Senior Data Engineer to lead the design, development and optimisation of modern enterprise data platforms. This is an exciting opportunity to play a key role in delivering scalable, secure and governed data solutions that support reporting, analytics and future AI initiatives across the organisation.

Working closely with Architects, Cyber Security, Infrastructure, Application and Analytics teams, you will provide technical leadership while delivering complex data platform modernisation and cloud transformation projects.

About the Role

As the Senior Data Engineer, you will be responsible for designing, building and supporting enterprise data solutions using the Microsoft Fabric ecosystem. Acting as a technical SME and escalation point, you will lead best practice implementation across data engineering, governance, performance optimisation and operational support.

Key responsibilities include:

  • Designing and optimising Microsoft Fabric solutions including OneLake, Lakehouses, Warehouses, Data Factory pipelines, Dataflows Gen2, Spark notebooks and Semantic Models
  • Implementing scalable Medallion Architecture across Bronze, Silver, Gold and Serving data layers
  • Developing resilient batch and near real-time data integration pipelines from enterprise applications, APIs, databases and cloud platforms
  • Building complex data transformations using SQL, Python and PySpark
  • Delivering data platform migration, modernisation and reporting transformation initiatives
  • Driving data quality, governance, security and compliance across the data lifecycle
  • Leading performance tuning, monitoring, optimisation and capacity management activities
  • Designing and supporting backup, recovery, high-availability and disaster recovery solutions
  • Providing technical leadership, mentoring and knowledge sharing across data teams
  • Supporting production-critical environments through troubleshooting, root cause analysis and continuous improvement initiatives

About You

You are a senior data engineering professional with deep expertise across Microsoft data platforms and a strong track record delivering enterprise-scale solutions in complex environments.

Essential Experience

  • 7+ years' experience supporting enterprise data platforms, database environments and data infrastructure services
  • Hands-on experience delivering Microsoft Fabric implementations and transformation projects
  • Strong expertise across:
    • Microsoft Fabric
    • OneLake, Lakehouse and Warehouse architectures
    • Azure Data Factory
    • Microsoft SQL Server and Azure SQL
    • Power BI and Semantic Models
    • SQL, Python and PySpark
  • Experience designing secure, scalable and governed cloud data platforms
  • Strong understanding of data governance, security, encryption, auditing and compliance requirements
  • Experience with performance tuning, backup and recovery, high availability and disaster recovery
  • Proven experience working within large-scale enterprise and cloud-enabled environments
  • Strong stakeholder engagement and communication skills with the ability to translate technical concepts into business outcomes

Highly Regarded

  • Microsoft Data, Azure or Fabric certifications
  • ITIL and/or ISO 27001 certifications
  • Experience with automation, PowerShell and Infrastructure-as-Code practices
  • Exposure to enterprise cloud transformation and data modernisation programs

Why Join Us?

  • Lead enterprise-wide data and analytics transformation initiatives
  • Work with cutting-edge Microsoft Fabric technologies
  • Influence architecture, standards and platform strategy
  • Collaborate with highly skilled technology and business teams
  • Deliver solutions that support advanced analytics, reporting and AI capabilities
  • Flexible and supportive working environment
  • Ongoing professional development and career growth opportunities

If you're passionate about modern data platforms and want to play a leading role in shaping the future of enterprise data and analytics, we'd love to hear from you.

Apply now and help build the data foundations that power better business decisions.

What you need to know about the Sydney Tech Scene

From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account