Data Engineer
- You are a data professional with strong proficiency in Cloud technologies ,Big Data ,Teradata, DevOps, and familiarity with Hadoop and AWS environments.
- We're one of the largest and most advanced Data Engineering teams in the country
- Together we can build state-of-the-art data solutions that power seamless experiences for millions of customers
Do work that matters
As an experienced data engineer with proven expertise in database development and a passion for providing data-driven solutions, you’re ahead of trends and work at the forefront of Data warehouse, Big Data and Cloud technologies.
Which is why we’re the perfect fit for you. Here, you’ll be part of a team of engineers going above and beyond to improve the standard of digital banking. Using the latest tech to solve our customers’ most complex data-centric problems.
To us, data is everything. It is what powers our cutting-edge features and it’s the reason we can provide seamless experiences for millions of customers from app to branch.
As a member of the Technology division, you will contribute to all aspects of the technology products and services we deliver, from technical strategy and design to coding to deployment to operation. Our data products and services are leveraged across various tech stacks.
What will set you up for success?
You will be reporting into Engineering Chapter Lead working closely with your peers to provide an end to end data delivery function focused on business performance reporting across the group. You will be responsible for key services offered by the team include the following: Technical analysis, solution detail design, application development and support, data delivery and support, and automation and process improvement.
We’re interested in hearing from people who
- Have design and implement databases and data models experience.
- Have experience in developing and maintain scripts or ETL (Extract, Transform, Load) processes to ingest raw data from various sources, including JSON and XML files using AWS Services.
- Can design and develop extracting messages from the Kafka topics and transform and load into Arora DB
- Must have experience working on Neal Real Time data processing.
- Hands on experience working on various AWS Services
- Exposure on Data warehousing and Big data technologies like Hadoop, Spark, Teradata , Abinitio etc
- Can create and optimize scripts to write transformed data into relational databases (e.g., PostgreSQL- Ensuring that data is properly indexed, normalized, and stored efficiently.)
- Can monitor and troubleshoot data pipelines to ensure reliability and performance.
- Can develop back-end database code to support API requirements.
- Can collaborate with business and technical teams in order to design and build critical databases and data pipelines.
- Can performance tune applications from a database code and design perspective.
- Can advise business owners on strategic database direction and application solution design.
Tech skills
We use a broad range of tools, languages, and frameworks. We don’t expect you to know them all but having significant experience and exposure with some of these (or equivalents) will set you up for success in this team.
- AWS Data products such as AWS Glue ,RedShift, AWS EMR, AWS Lambda, Athena, Kinesis, MSK, Iceberg , Data Zone.
- AWS Aurora RDS such as PostgreSQL
- AWS S3 ingestion, transformation and writing to databases
- Realtime streaming technologies, Kafka, Flink
- Proficiency in any of the programming languages like Python, Java, or Scala for developing data ingestion and transformation scripts.
- Strong knowledge of SQL for writing, optimizing, and debugging queries.
- Understanding of data formats (JSON, CSV, XML) and techniques for converting between them. Ability to handle data validation, cleaning, and transformation.
- Experience with version control systems (e.g., Git) for managing code and collaboration.
Working with us
Whether you’re passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you.
Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.
Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring technologists from across all of Australia and have opened technology hubs in Melbourne, Adelaide, Brisbane and Perth. We really love working here, and we think you will too.
If this sounds like the role for you then we would love to hear from you.
Apply today!
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Advertising End Date: 10/11/2024
Commonwealth Bank Sydney, New South Wales, AUS Office
Sydney, New South Wales, Australia
