CoStar Group Logo

CoStar Group

Senior Data Engineer - Data Platform

Reposted One Month Ago
Be an Early Applicant
In-Office
Sydney, New South Wales, AUS
Senior level
In-Office
Sydney, New South Wales, AUS
Senior level
Design, build, and operate scalable batch and real-time data pipelines and Lakehouse data assets using AWS, Snowflake, Databricks, Kafka, and Flink. Collaborate with data science, analytics, and product teams to ensure data quality, modelling, governance, performance, and cost-efficiency.
The summary above was generated by AI
Senior Data Engineer - Data Platform


Job Description


Role Summary 

Exciting opportunity for a Senior Data Engineer to join Domain – CoStar in a period of great opportunity and growth. You will have a direct impact on the continued success of Domain-CoStar in the APAC region. Leveraging the largest reality data sets in the local market, to enhance Domain-CoStar’s product service offering and refine internal business practices.  

 

The purpose of this role is to build data platform capabilities for batch and streaming pipelines on our Lakehouse and develop data assets that serve as the source and authority for data-driven decisions and analytics used across the business.

You will design, develop and operate a data platform and data pipelines which serve Domain’s products and internal data teams like data product, data science, data  analytics and ML/AI. 

 

What you’ll do 

  • Solution Design: Design and build re-usable, scalable data solutions and assets on a modern Lakehouse platform across a constantly evolving landscape of products and internal data teams.  

  • Pipeline Development: Build and maintain robust, reliable pipelines using DBT, Apache Airflow, Snowflake, Databricks and AWS services.  

  • Streaming & Real-Time: Develop real-time data pipelines using Apache Kafka and Apache Flink to support low-latency, event-driven use cases.  

  • Data Integration: Connect to a wide variety of internal and external sources via multiple methods (SaaS solutions, APIs, direct connections, streaming) on cloud architecture. 

  • Cloud Data Architecture: Architect and implement data solutions on AWS, Snowflake and Databricks, applying best practices for cloud-native data warehousing and cost-efficiency.  

  • Lakehouse Architecture: Build and optimise open Lakehouse table formats such as Apache Iceberg, managing schema evolution, partitioning, and performance.  

  • Modern Data Modelling: Apply modern data modelling practices that evolve with the business in an agile environment.  

  • Performance & Cost: Write and optimise complex SQL and Spark workloads to keep solutions efficient in both time and cost. 

  • Data quality and governance  

  • Cross-functional Partnership: Work closely with data scientists, analysts, product managers, and engineers across the Domain Group to deliver data solutions that drive business value.  

  • Continuous Improvement: Challenge the status quo — proactively identify opportunities to improve data processes, reduce costs, and increase reliability. 

Essential: 

  • At least 5+ years of hands-on commercial experience in software or data engineering.  

  • 4+ years of strong development experience in SQL and Python.  

  • Proven experience with data integration and orchestration tools, including Apache Airflow, DBT, and AWS Glue.  

  • Expert on some of the modern cloud data platforms and architectures, such as Snowflake, Databricks, and Lakehouse architecture  

  • Experience designing and building data solutions on AWS cloud infrastructure.  

  • Experience working with semi-structured and unstructured data.  

  • Strong data modelling skills with the ability to evolve models in an agile environment.  

  • Hands-on experience building streaming and real-time pipelines with Apache Kafka and Apache Flink.  

  • Knowledge of infrastructure-as-code tools such as CDK, CloudFormation, or Terraform.  

  • Degree in computer science, engineering, mathematics, statistics, or a related technical field 

What’s In It For You? 

Working at CoStar Group means you'll enjoy a culture of collaboration and innovation that attracts the best and brightest across a broad range of disciplines. We offer you generous compensation and performance-based incentives. As well as having an outstanding working environment, other perks include extra days of annual leave, leadership development programs, LinkedIn Learning, Perkbox discounts and much more!  

 

About Domain (part of the CoStar Group) 

 

Domain is a leading property technology and services marketplace that is home to one of the largest portfolios of property brands in Australia, including the Domain, Allhomes and Commercial Real Estate (CRE) platforms. In 2025, Domain became part of CoStar Group - a global leader in commercial real estate information, analytics, online marketplaces and 3D digital twin technology. We are dedicated to digitising the world’s real estate, empowering all people to discover properties, insights, and connections that improve their businesses and lives. 

Equity, Diversity & Inclusion 

Domain is enthusiastically and unapologetically committed to fostering an equitable, inclusive work culture which reflects our customers and communities. We are proactively looking for candidates from all lived experiences, including people with disability, and people of all ages, ethnicities, cultures (including Aboriginal and Torres Strait Islander Peoples), faiths, sexual orientations, and gender identities (including trans and non-binary people). 

We are committed to providing an equitable recruitment process for people with disability. If you require adjustments during the process we’re here to support. If you wish to receive this job advertisement in an accessible format, or have a confidential chat about workplace adjustments, please contact our Equity, Diversity and Inclusion team at [email protected] or leave a message on 1300 858 356 and we will get back to you. 


CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing

Similar Jobs

Yesterday
In-Office or Remote
Sydney, New South Wales, AUS
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Design, develop, and own scalable big data and software solutions for Atlassian’s internal data platform. Collaborate with engineers and architects to ship features, uphold coding standards, and improve security, reliability, availability, performance, and operational excellence. Build and deploy services using distributed systems, cloud platforms, and big data technologies while applying data-driven problem solving.
Top Skills: AirflowAWSDatabricksDbtFlinkGCPJavaKotlinPythonScalaSparkStarrocks
Yesterday
Remote or Hybrid
Mid level
Mid level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Owns a Newcastle sales territory for Square, generating pipeline through in-person outreach, partnerships, events, and networking. Conducts business visits, demos, consultative full-cycle sales, and deal closing across Square’s commerce products. Builds seller relationships, manages referrals, supports onboarding, maintains Salesforce pipeline accuracy, forecasts performance, and exceeds sales quotas. Requires reliable transportation and substantial field activity.
Top Skills: Payment Processing TechnologySalesforce
Yesterday
Remote or Hybrid
Sydney, New South Wales, AUS
Expert/Leader
Expert/Leader
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Owns strategic enterprise accounts in Australia’s financial services sector, developing executive relationships, creating expansion opportunities, and driving complex SaaS sales cycles. Responsibilities include account planning, pipeline generation, forecasting, territory strategy, executive engagement, and positioning Dynatrace across observability, cloud modernization, security, AI, automation, and digital experience initiatives. The role requires collaboration with technical, customer success, professional services, marketing, partner, and executive teams.
Top Skills: AiopsAWSCloud ComputingCybersecurityDevOpsDynatraceGCPAzureObservabilitySaaS

What you need to know about the Sydney Tech Scene

From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account