XPT Software Australia Pty Ltd Jobs

Senior Data Engineer

XPT Software Australia Pty Ltd

Senior Data Engineer

Posted 24 Days Ago

Be an Early Applicant

In-Office

Sydney, New South Wales, AUS

Senior level

In-Office

Sydney, New South Wales, AUS

Senior level

Designs, builds, and operates scalable, secure, high-performance data platforms and pipelines supporting analytics, reporting, machine learning, and real-time insights. Collaborates with analytics, data science, product, and business teams; mentors engineers; optimizes Databricks workloads; and drives architecture, engineering standards, governance, and cloud cost efficiency.

The summary above was generated by AI

Job Description:

Must Have Skills:

 Strong hands‑on experience with Azure Data Lake Gen2, Synapse, Databricks

 Solid experience in PySpark / Spark SQL, Databricks performance tuning & job optimization

 Proficient in Complex SQL (window functions, CTEs, execution plans)

 Strong understanding in Mentoring junior and mid‑level engineers, Communicating trade‑offs to architects and product teams

 Experience working with Azure DevOps or GitHub Actions

Nice to Have Skills:

 Experience with Streaming & Real‑Time Data Processing on Designing low‑latency pipelines.

 Exposure to Data Governance & Metadata Management in Data classification & sensitivity labels

 Familiarity with Advanced Python Engineering Practices on Performance‑aware Python design

 Experience working in Analytics & BI Awareness

 Knowledge of Cloud Cost Optimization & FinOps

Detailed Job Description

The Senior Data Engineer will be responsible for designing, building, and operating scalable, secure, and high‑performance data platforms. The role involves critical data pipelines and architectures that power analytics, reporting, and advanced data use cases such as machine learning and real‑time insights.

The candidate will collaborate closely with analytics, data science, product, and business teams while mentoring engineers and driving engineering best practices across the data organization.

The role combines technical leadership, architecture ownership, and business impact.

Similar Jobs

Qantas

Senior Data Engineer

Yesterday

In-Office

Sydney, New South Wales, AUS

Senior level

Information Technology • Marketing Tech • Transportation • Travel • Financial Services

Develop and operate scalable data platforms and pipelines across their full lifecycle. Design cloud-based solutions, build reliable data products, optimize Snowflake and cloud costs, and implement orchestration, transformation, testing, security, governance, and observability. Provide technical direction, review designs and code, mentor engineers, and collaborate with architects, product owners, analysts, and visualization engineers.

Top Skills: AlationApache AirflowApache KafkaAWSAws Managed Workflows For Apache AirflowAzureCloudabilityDatadogDatastageDbtGCPPower BIPythonSnowflakeSnowflake DcmSnowflake OpenflowSQLTeradataTerraform

Accenture

Data Architect

4 Days Ago

In-Office

Senior level

Information Technology

Designs and leads enterprise-scale data architectures and platforms for client projects. Responsibilities include data strategy, modelling, governance, quality, cloud and hybrid data integration, AI-ready platforms, CI/CD, infrastructure automation, analytics tooling, security, and compliance. The role mentors technical teams, manages stakeholders, evaluates emerging technologies, and translates business requirements into scalable technical solutions across Azure, AWS, and GCP.

Top Skills: AnsibleSparkAWSAws GlueAzureAzure Data FactoryAzure DevopsCi/CdData LakehouseDatabricksDockerGithub ActionsGoogle Cloud DataflowGoogle Cloud PlatformJenkinsKubernetesPower BIPowerappsPythonScalaSnowflakeSQLTableauTerraform

Atlassian

Platform Engineer

10 Days Ago

In-Office or Remote

Sydney, New South Wales, AUS

Senior level

Cloud • Information Technology • Productivity • Security • Software • App development • Automation

Design, develop, and own scalable big data and software solutions for Atlassian’s internal data platform. Collaborate with engineers and architects to ship features, uphold coding standards, and improve security, reliability, availability, performance, and operational excellence. Build and deploy services using distributed systems, cloud platforms, and big data technologies while applying data-driven problem solving.

Top Skills: AirflowAWSDatabricksDbtFlinkGCPJavaKotlinPythonScalaSparkStarrocks

What you need to know about the Sydney Tech Scene

From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.