Build and optimize scalable data pipelines and cloud-based data solutions using Python, PySpark, SQL, and Snowflake. Integrate REST APIs and external data sources, develop ETL/ELT workflows, optimize Snowflake queries, and implement data quality, validation, monitoring, and automation. Collaborate with engineering and analytics teams to deliver reliable data platforms.
Job Description
Data Engineer - Python, PySpark, SQL, Snowflake & API Integration
Job Description:
We are seeking a skilled Data Engineer with strong hands-on experience in Python, PySpark, SQL, Snowflake, and API integrations to build scalable data pipelines and cloud-based data solutions.
Key Responsibilities:
- Design, develop, and optimize data pipelines using Python, PySpark, SQL, and Snowflake.
- Integrate REST APIs and external data sources into Snowflake-based data platforms.
- Build and maintain ETL/ELT workflows for data ingestion, transformation, and processing.
- Develop efficient SQL queries and optimize Snowflake performance.
- Implement data quality, validation, monitoring, and automation.
- Collaborate with engineering and analytics teams to deliver reliable data solutions.
Required Qualifications:
- 3+ years of experience in Data Engineering.
- Strong hands-on expertise in Python, PySpark, SQL, and Snowflake.
- Experience with REST APIs, JSON, and API-based data integration.
- Knowledge of ETL/ELT processes, data modeling, and data warehousing.
- Experience with cloud platforms such as AWS, Azure, or GCP is preferred.
Additional Information
All your information will be kept confidential according to EEO guidelines.
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Own the full sales cycle for Samsara’s IoT solutions, targeting small and medium-sized businesses with 11–30 vehicles. Responsibilities include outbound prospecting, lead qualification, pipeline generation, customer engagement, pricing negotiations, proof-of-concept sales, and closing transactional deals. The role requires high-volume cold calling, quota achievement, relationship building, and collaboration in a remote, fast-paced sales environment.
Top Skills:
Internet Of Things (Iot)SFDC
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The role involves developing executive relationships, managing customer engagements, and achieving revenue growth through strategic sales efforts focused on government agencies.
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead the technical direction and implementation of large-scale SaaS product features. Build secure, reliable, maintainable, well-tested software; evaluate architectural trade-offs; debug team inefficiencies; and contribute to code reviews, documentation, and complex bug fixes. Collaborate across product, design, and engineering, influence strategy, identify organizational blockers, mentor engineers, and improve engineering practices around testing, performance, security, privacy, and reliability.
Top Skills:
AWSDistributed SystemsJavaKotlinMicroservicesObservability ToolsSaaS
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
