Similar Jobs
Big Data • Analytics • Business Intelligence • Big Data Analytics
As an AWS Data Engineer, design and maintain large-scale data pipelines using AWS services, Databricks, and Apache Spark, collaborating with teams to meet data requirements.
Top Skills:
Amazon RedshiftApache AirflowSparkAws GlueAws LambdaAws S3DatabricksGitSpark SqlSQL
Artificial Intelligence • Information Technology • Consulting
The Senior Data Engineer will design and manage data pipelines, work with diverse teams on data solutions, and engage in R&D initiatives.
Top Skills:
AirflowApache DruidAWSAws CloudformationAzureDagsterDatabricksDbtFastapiFlaskGCPKafkaPythonSnowflakeSparkSQLTerraform
Big Data • Analytics • Business Intelligence • Big Data Analytics
Seeking a Data Engineer with expertise in database design, AWS services, and data analysis to help solve business challenges.
Top Skills:
AthenaAWSEc2EmrJavaMySQLPostgresPythonScala
Senior Data Engineer/Developer
🌟 Accomplished Tech Visionary:
Embark on an exciting journey into the realm of software development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Developer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
RESPONSIBILITIES
- Analyze and develop data solutions, including automation, integration and unit tests
- Create solutions that prevent data corruption while ensuring data consistency and reliability
- Collaborate with other teams and stakeholders to understand data requirements
- Actively contribute to reviews by providing constructive feedback to team members
- Ensure technical solutions and system integrations are developed and maintained in the most efficient and effective manner
REQUIREMENTS
- Data Engineer with mandatory experience working with AWS tech stack i.e. (RedShift, Glue, Step functions, QuickSight etc)
- Proficient with Python
- Experience with SQL in writing code.
- Experience designing and implementing and orchestrating data pipelines
- Communicates moderate to complex technical concepts to technical and non-technical personnel
- Experience designing and building data environments to support reporting and analytics, including data integrations and flow between disparate data systems.
- Experience with data modelling, data engineering, and/or data warehouse building.
BENEFITS
- At 3Pillar, we offer a world of opportunity:
- Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach.
- You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams.
- We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best.
- Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.
- We are an equal opportunity employer. It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally.
- Join us and be a part of a global tech community! 🌍💼 Check out our Linkedin site and Careers page to learn more about what it’s like to be part of our #oneteam!
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
