Endava Logo

Endava

Senior Data Engineer - GCP

Posted 12 Days Ago
Be an Early Applicant
Sydney, New South Wales
Senior level
Sydney, New South Wales
Senior level
The Senior Data Engineer is responsible for designing and implementing data processing solutions, ensuring data quality, and collaborating with data teams to extract insights and drive innovation.
The summary above was generated by AI

Company Description

Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.
 
By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.
 
From prototype to real-world impact - be part of a global shift by doing work that matters.

Job Description

Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling. 

Responsibilities:

  • Work closely with the Data Analyst/Data Scientist to understand evolving needs and define the data processing flow or interactive reports.
  • Discuss with the stakeholders from other teams to better understand how data flows are used within the existing environment.
  • Propose solutions for the cloud-based architecture and deployment flow.
  • Design and build processes, data transformation, and metadata to meet business requirements and platform needs.
  • Design and propose solutions for the Relational and Dimensional Model based on platform capabilities.
  • Develop, maintain, test, and evaluate big data solutions.
  • Focus on production status and data quality of the data environment.
  • Pioneer initiatives around data quality, integrity, and security.

Qualifications

  • +5 years working with the GCP ecosystem.
  • +5 years of experience in Data Engineering.
  • Proficiency in Apache Spark.
  • Proficiency in Python.
  • Some experience leading IT projects and stakeholder management.
  • Experience implementing ETL/ELT process and Data pipelines.
  • Experience with Snowflake.
  • Strong SQL scripting experience.
  • Background and experience with cloud data technologies and tools.
  • Familiar with data tools and technologies like:
  • Spark, Hadoop, Apache beam, Dataproc or similar.
  • BigQuery, Redshift, or other Data warehouse tools.
  • Real-time pipelines with Kinesis or Kafka.
  • Batch processing.
  • Serverless processing.
  • Strong analytic skills related to working with structured and unstructured data sensibilities.
  • Cloud certifications such as Associate Cloud Engineer will be an asset.

Additional Information

Discover some of the global benefits that empower our people to become the best version of themselves:

  • Finance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;  
  • Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
  • Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
  • Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme;
  • Health: Global internal wellbeing programme, access to wellbeing apps;
  • Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.

Our diversity makes us stronger - it drives meaningful change and enables us to build innovative technology solutions. We are committed to creating an inclusive community where all of us, regardless of background, identity, or personal characteristics, feels valued, respected, and free from discrimination. As an equal opportunity employer, we welcome applications from all individuals and base hiring decisions on merit, skills, qualifications, and potential.

Top Skills

Apache Beam
Spark
BigQuery
Dataproc
GCP
Hadoop
Kafka
Kinesis
Python
Redshift
Snowflake
SQL

Endava Sydney, New South Wales, AUS Office

Sydney, New South Wales, Australia

Similar Jobs

3 Days Ago
Remote
Sydney, New South Wales, AUS
Expert/Leader
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Principal Machine Learning Engineer, you will lead AI and ML projects, mentor engineers, and solve complex architecture challenges to improve IT operations at Atlassian.
Top Skills: AWSJavaKerasKotlinNumpyPandasPythonPyTorchSci-Kit-LearnTensorFlow
5 Days Ago
Hybrid
Sydney, New South Wales, AUS
Mid level
Mid level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
As a Data Analyst at Dynatrace, you'll provide insights into client performance through data analysis, manage client relationships, and drive optimization strategies.
Top Skills: AdobeAdvanced ExcelCloudContent Delivery NetworksCSSGoogle AnalyticsHTMLJavaScriptNetworkingRSpssTableau
5 Days Ago
Hybrid
Sydney, New South Wales, AUS
Senior level
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
The role involves building ML models for detecting fraud, collaborating with teams, and contributing to modeling capabilities within Cash App's Risk ML team.
Top Skills: AWSGCPKerasModeMySQLNumpyPandasPythonSklearnSnowflakeTableauTensorFlowXgboost

What you need to know about the Sydney Tech Scene

From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account