Shift (shift.com.au) Logo

Shift (shift.com.au)

Senior Data Engineer

Reposted 2 Days Ago
Be an Early Applicant
In-Office
North Sydney, New South Wales
Senior level
In-Office
North Sydney, New South Wales
Senior level
As a Senior Data Engineer, you will design, develop, and maintain secure ELT data pipelines on Azure, ensuring data accuracy and governance while collaborating with teams to deliver actionable insights.
The summary above was generated by AI
Company Description

At Shift, we’re business specialists dedicated to helping Australian SMEs take control of their cashflow, streamline trade terms and choose the right financial products. 

We believe Australian businesses are the driving force behind our economy and are core to our communities. That’s why our business expertise, focus on relationships, and market-leading technology is at the core of everything we do.  

Our unique approach to product innovation combined with our collaborative culture means you can build your career in a supportive environment. You’ll be joining a diverse team of over 250 people who are always looking to deliver better outcomes for Australian businesses. 

Job Description

We're looking for a Senior Data Engineer who’s passionate about creating data solutions that power thoughtful decision-making. In this role, you’ll build and maintain modern data pipelines on Azure using tools like Databricks, Azure Data Factory, and Delta Lake, while contributing to a team that values collaboration, inclusion, and continuous improvement.

This is a great opportunity for someone who enjoys partnering with diverse teams, bringing ideas to life, and building scalable solutions that have real business impact.

What you’ll do:

  • Design, develop, and maintain secure, scalable ELT data pipelines using Azure tools
  • Ensure data is accurate, consistent, and ready for analysis through strong governance practices
  • Collaborate closely with analysts, engineers, and business stakeholders to understand goals and deliver trusted data products
  • Build data models that consolidate complex sources into actionable insights
  • Identify opportunities to improve performance, reliability, and cost-efficiency across systems
  • Support the development of others through knowledge sharing, mentoring, and inclusive design practices
  • Contribute to architecture, documentation, and automation to help the team scale sustainably
  • Use tools like Unity Catalog, Azure Functions, and DevOps pipelines to manage metadata, schema evolution, and deployment

Qualifications

What you'll have: 

  • Around 5+ years of experience in data engineering or a related field
  • Proficiency in Python and SQL, with a focus on clean, maintainable code
  • Experience with Azure Databricks, Delta Lake, Azure SQL, and Azure Data Lake Gen2
  • Familiarity with CI/CD practices and data orchestration using tools like Azure Functions and Delta Live Tables
  • A collaborative mindset and strong communication skills - able to partner across technical and non-technical teams
  • A passion for solving complex problems and improving data systems over time
  • Commitment to continuous learning and staying current with evolving technologies
  • Relevant tertiary qualifications or equivalent experience

Additional Information

Key benefits: 

  • Collaborative teams – a flat structure means everyone can learn from colleagues and senior leaders around the business.  
  • Be involved – come together with all of your colleagues every 100 days to share the product and technology roadmap and business strategy.  
  • Flexible working environment – we’re headquartered in North Sydney with state based workplaces and offer a flexible work policy.  
  • Family support – industry leading 26 weeks paid parental leave.  
  • Varied workspaces – our office enables areas for collaboration, brainstorming and socialising as well as focus zones. 
  • Range of benefits – supporting your physical, psychological and financial wellbeing. 

#LI-Hybrid

Top Skills

Azure Data Lake Gen2
Azure Databricks
Azure Functions
Azure Sql
Ci/Cd
Delta Lake
Delta Live Tables
DevOps
Python
SQL

Shift (shift.com.au) North Sydney, New South Wales, AUS Office

177 Pacific Hwy, North Sydney, New South Wales, Australia, 2060

Similar Jobs

10 Days Ago
In-Office
Sydney, New South Wales, AUS
Senior level
Senior level
Fintech • Software • Financial Services
The Senior Data Engineer will design, develop, and deploy AI systems, focusing on data pipeline maintenance, optimization, and governance while ensuring data quality and compliance.
Top Skills: AirflowAws BedrockAws SagemakerAws ServicesDatabricksDbtDockerMs FabricPower BIPythonS3SnowflakeTerraform
13 Days Ago
Hybrid
Sydney, New South Wales, AUS
Senior level
Senior level
Fintech • Payments • Financial Services
The Senior Data Engineer will design, build, and maintain scalable cloud-based data platforms, ensuring data integrity and security while optimizing ETL/ELT pipelines using Python and SQL.
Top Skills: AzureCi/CdDbtPythonSnowflakeSQL
23 Days Ago
Hybrid
Sydney, New South Wales, AUS
Senior level
Senior level
Software
As Lead Data Engineer, you will design and maintain insurance data assets, ensuring data availability for analysis and business decisions while collaborating with internal teams and stakeholders.
Top Skills: Apache AirflowApache KafkaSparkAws Ec2Aws EksAws EmrAws GlueAws RedshiftAws S3DockerHexJavaKubernetesLinuxMicrostrategyPostgresPower BIPythonQliksenseRSas VaScalaShellSQLTableauTerraform

What you need to know about the Sydney Tech Scene

From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account