XPT Software Australia Pty Ltd Jobs

Senior Data Engineer

XPT Software Australia Pty Ltd

Senior Data Engineer

Posted 6 Hours Ago

Be an Early Applicant

In-Office

Sydney, New South Wales, AUS

Senior level

In-Office

Sydney, New South Wales, AUS

Senior level

Designs, builds, and operates scalable, secure, high-performance data platforms and pipelines supporting analytics, reporting, machine learning, and real-time insights. Collaborates with analytics, data science, product, and business teams; mentors engineers; optimizes Databricks workloads; and drives architecture, engineering standards, governance, and cloud cost efficiency.

The summary above was generated by AI

Job Description:

Must Have Skills:

 Strong hands‑on experience with Azure Data Lake Gen2, Synapse, Databricks

 Solid experience in PySpark / Spark SQL, Databricks performance tuning & job optimization

 Proficient in Complex SQL (window functions, CTEs, execution plans)

 Strong understanding in Mentoring junior and mid‑level engineers, Communicating trade‑offs to architects and product teams

 Experience working with Azure DevOps or GitHub Actions

Nice to Have Skills:

 Experience with Streaming & Real‑Time Data Processing on Designing low‑latency pipelines.

 Exposure to Data Governance & Metadata Management in Data classification & sensitivity labels

 Familiarity with Advanced Python Engineering Practices on Performance‑aware Python design

 Experience working in Analytics & BI Awareness

 Knowledge of Cloud Cost Optimization & FinOps

Detailed Job Description

The Senior Data Engineer will be responsible for designing, building, and operating scalable, secure, and high‑performance data platforms. The role involves critical data pipelines and architectures that power analytics, reporting, and advanced data use cases such as machine learning and real‑time insights.

The candidate will collaborate closely with analytics, data science, product, and business teams while mentoring engineers and driving engineering best practices across the data organization.

The role combines technical leadership, architecture ownership, and business impact.

Similar Jobs

Western Sydney University

Senior Data Engineer

7 Days Ago

Hybrid

Senior level

Edtech • Other • Professional Services

Design, develop, and optimise secure data pipelines, ETL/ELT processes, integrations, and transformation workflows for university analytics, reporting, and operational use. Use Azure Data Factory, Alteryx, Snowflake, Azure, SQL, and Python while implementing medallion architecture, data quality checks, version control, and reliability measures. Collaborate with enterprise architecture and cross-functional stakeholders, troubleshoot pipeline issues, provide technical guidance, and contribute to scalable data engineering frameworks and strategic initiatives.

Top Skills: AlteryxAzureAzure Data FactoryEltETLMedallion ArchitecturePythonSnowflakeSQL

humm group

Senior Data Engineer

9 Days Ago

In-Office

Sydney, New South Wales, AUS

Senior level

Fintech • Software • Financial Services

Senior Data Engineer responsible for modernizing and simplifying data platforms across legacy and cloud environments. The role involves designing Snowflake, dbt, and Azure Data Factory solutions; supporting SQL Server warehouses; building pipelines and data products; improving reliability, governance, security, lineage, and operational excellence; and partnering with stakeholders during platform transformation. The engineer will also help enable future AI and machine-learning workloads through quality data products, model-supporting pipelines, and monitoring capabilities.

Top Skills: Aws GlueAws S3Azure Data FactoryCi/Cd PipelinesData Orchestration ToolsDbtDbt CloudAzurePythonQlik ReplicaSnowflakeSQLSQL Server

Lendi Group

Senior Data Engineer

11 Days Ago

Hybrid

Sydney, New South Wales, AUS

Senior level

Fintech • Software • Financial Services

Design, develop, deploy, and support scalable cloud-based data pipelines, warehouses, ETL processes, and data models. Optimize performance, reliability, and data quality while applying governance standards. Collaborate with analysts, data scientists, engineers, and business stakeholders on AI-driven solutions. Create technical documentation, resolve incidents, contribute to architecture and engineering standards, and mentor other engineers.

Top Skills: Amazon BedrockAmazon S3Amazon SagemakerApache AirflowSparkAWSCi/CdDatabricksDbtDockerLangchainMlflowPostgresPythonSnowflakeSQLTerraform

What you need to know about the Sydney Tech Scene

From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.