The Senior Data Engineer will create and maintain data solutions, model data for stakeholders, enhance data quality, and ensure reliable data practices.
Working at Atlassian
Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Team: Core Engineering Reliability Team
Minimum Qualifications / Your background:
Desirable Qualifications
Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Team: Core Engineering Reliability Team
- Collaborate with engineering and TPM leaders, developers, and process engineers to create data solutions that extract actionable insights from incident and post-incident management data, supporting objectives of incident prevention and reducing detection, mitigation, and communication times.
- Work with diverse stakeholders to understand their needs and design data models, acquisition processes, and applications that meet those requirements.
- Add new sources, implement business rules, and generate metrics to empower product analysts and data scientists.
- Serve as the data domain expert, mastering the details of our incident management infrastructure.
- Take full ownership of problems from ambiguous requirements through rapid iterations.
- Enhance data quality by leveraging and refining internal tools and frameworks to automatically detect issues.
- Cultivate strong relationships between teams that produce data and those that build insights.
Minimum Qualifications / Your background:
- BS in Computer Science or equivalent experience with 8+ years as a Senior Data Engineer or similar role
- 10+ Years of progressive experience in building scalable datasets and reliable data engineering practices.
- Proficiency in Python, SQL, and data platforms like DataBricks
- Proficiency in relational databases and query authoring (SQL).
- Demonstrable expertise designing data models for optimal storage and retrieval to meet product and business requirements.
- Experience building and scaling experimentation practices, statistical methods, and tools in a large scale organization
- Excellence in building scalable data pipelines using Spark (SparkSQL) with Airflow scheduler/executor framework or similar scheduling tools.
- Expert experience working with AWS data services or similar Apache projects (Spark, Flink, Hive, and Kafka).
- Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
- Well versed in modern software development practices (Agile, TDD, CICD)
Desirable Qualifications
- Demonstrated ability to design and operate data infrastructure that deliver high reliability for our customers.
- Familiarity working with datasets like Monitoring, Observability, Performance, etc..
Top Skills
Airflow
AWS
Databricks
Flink
Hive
Kafka
Python
Spark
SQL
Atlassian Australia Office
Atlassian Australia Office
Similar Jobs at Atlassian
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you'll build a data lake, optimize data pipelines, and support business needs, focusing on data quality and efficiency.
Top Skills:
AirflowAWSData Build ToolDatabricksEmrHiveJavaKappa ArchitectureKinesisPythonRdsS3ScalaSparkSQLSqs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer at Atlassian, you will build and maintain data pipelines, manage a data lake, and optimize data ingestion processes while collaborating with business stakeholders.
Top Skills:
AirflowAWSData Build ToolDatabricksEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Data Engineer, you'll build data products, improve data ingestion, and design self-serve capabilities while working with various data technologies.
Top Skills:
AirflowAmazon Web ServicesDatabricksEmrJavaKinesisPythonRdsS3ScalaSparkSQLSqs
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
