XPT Software Australia Pty Ltd Jobs

Senior Data Engineer

XPT Software Australia Pty Ltd

Senior Data Engineer

Posted One Month Ago

Be an Early Applicant

In-Office

Sydney, New South Wales, AUS

Senior level

In-Office

Sydney, New South Wales, AUS

Senior level

Designs, builds, and operates scalable, secure, high-performance data platforms and pipelines supporting analytics, reporting, machine learning, and real-time insights. Collaborates with analytics, data science, product, and business teams; mentors engineers; optimizes Databricks workloads; and drives architecture, engineering standards, governance, and cloud cost efficiency.

The summary above was generated by AI

Job Description:

Must Have Skills:

 Strong hands‑on experience with Azure Data Lake Gen2, Synapse, Databricks

 Solid experience in PySpark / Spark SQL, Databricks performance tuning & job optimization

 Proficient in Complex SQL (window functions, CTEs, execution plans)

 Strong understanding in Mentoring junior and mid‑level engineers, Communicating trade‑offs to architects and product teams

 Experience working with Azure DevOps or GitHub Actions

Nice to Have Skills:

 Experience with Streaming & Real‑Time Data Processing on Designing low‑latency pipelines.

 Exposure to Data Governance & Metadata Management in Data classification & sensitivity labels

 Familiarity with Advanced Python Engineering Practices on Performance‑aware Python design

 Experience working in Analytics & BI Awareness

 Knowledge of Cloud Cost Optimization & FinOps

Detailed Job Description

The Senior Data Engineer will be responsible for designing, building, and operating scalable, secure, and high‑performance data platforms. The role involves critical data pipelines and architectures that power analytics, reporting, and advanced data use cases such as machine learning and real‑time insights.

The candidate will collaborate closely with analytics, data science, product, and business teams while mentoring engineers and driving engineering best practices across the data organization.

The role combines technical leadership, architecture ownership, and business impact.

Similar Jobs

Nine

Senior Data Engineer

3 Days Ago

In-Office

North Sydney, Sydney, New South Wales, AUS

Senior level

Digital Media • News + Entertainment

Designs and maintains scalable data pipelines and models, centralizes enterprise data in a warehouse, and processes hundreds of millions of daily events. Leads technical solution design, promotes coding, DevOps, metadata, and testing standards, and integrates AI tools into engineering workflows. Collaborates with Product, Cyber Security, Platform Engineering, and stakeholders to deliver data publishing solutions, resolve incidents, document systems, and shape requirements.

Top Skills: Ai ToolsApache AirflowAWSAzureCi/CdCloud BuildConcourseData PipelinesData WarehousingDbtDevOpsGCPInfrastructure As CodeOlapOltpPythonSQLTerraform

APM Group

Senior Data Engineer

4 Days Ago

Hybrid

North Sydney, New South Wales, AUS

Senior level

Healthtech • Professional Services • Social Impact

Lead the design, development, optimization, and support of enterprise data platforms using Microsoft Fabric. Build scalable batch and near-real-time pipelines, lakehouses, warehouses, semantic models, and data transformations. Drive governance, security, performance, disaster recovery, and platform modernization while supporting production environments. Provide technical leadership, mentoring, stakeholder engagement, troubleshooting, and continuous improvement across enterprise data and analytics initiatives.

Top Skills: SparkAzureAzure Data FactoryAzure SqlData WarehouseDataflows Gen2Infrastructure As CodeIso 27001ItilLakehouseMedallion ArchitectureMicrosoft FabricMicrosoft Sql ServerOnelakePower BIPowershellPysparkPythonSemantic ModelsSpark NotebooksSQL

TMGM

Senior Data Engineer

6 Days Ago

In-Office

Sydney, New South Wales, AUS

Senior level

Fintech • Financial Services

Design and evolve scalable, fault-tolerant ETL/ELT pipelines and real-time data systems for financial analytics. Lead Kafka and RabbitMQ stream processing, optimize ClickHouse schemas and queries, deploy secure cloud-based data services, and implement monitoring and automated recovery. Collaborate with leadership, support data governance, mentor engineers through technical guidance and code reviews, and independently develop and optimize Python and SQL pipelines handling high-throughput market and transactional data.

Top Skills: AirflowClickhouseCloud EnvironmentsEltETLKafkaPythonRabbitMQReal-Time Data ProcessingSQLStream Processing

What you need to know about the Sydney Tech Scene

From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.