Lead the design and implementation of scalable AI/ML platforms using Databricks, focusing on architecture, data ingestion, and MLOps frameworks. Collaborate with stakeholders to create production-ready AI solutions.
We are looking for an experienced AI Architect with strong expertise in Databricks, Data Engineering, Machine Learning, and Cloud-based AI solutions to lead the design and implementation of scalable AI/ML platforms and intelligent data solutions. The ideal candidate will define enterprise AI architecture, drive modern data and AI transformation initiatives, and work closely with business, engineering, and analytics teams to deliver high-impact solutions.
This role requires a strong understanding of end-to-end AI/ML lifecycle, Lakehouse architecture, Databricks ecosystem, and the ability to translate business use cases into production-ready AI solutions.
Key Responsibilities- Design and implement enterprise AI/ML architecture using Databricks Lakehouse Platform.
- Define scalable solutions for data ingestion, feature engineering, model training, deployment, monitoring, and governance.
- Architect and optimize AI/ML pipelines using Databricks, Spark, Python, SQL, and cloud-native services.
- Lead the setup of MLOps / LLMOps frameworks for model lifecycle management, CI/CD, model registry, and automated deployment.
- Work with business stakeholders to identify and prioritize AI/ML use cases, including predictive analytics, NLP, recommendation engines, and generative AI.
- Build and guide architecture for LLM / Generative AI solutions, including RAG, vector databases, prompt orchestration, and model integration where applicable.
- Establish best practices for data quality, security, compliance, observability, scalability, and responsible AI.
- Collaborate with Data Engineers, Data Scientists, Product Owners, and Cloud teams to ensure solution alignment with enterprise architecture standards.
- Provide technical leadership in selecting AI/ML tools, frameworks, and cloud services aligned to business and platform strategy.
- Support architecture reviews, technical design workshops, PoCs, and enterprise AI roadmap planning.
- 8- 15 years of experience in Data / AI / Analytics architecture, with strong exposure to enterprise-scale implementations.
- Hands-on experience with Databricks including:
- Databricks Lakehouse
- Delta Lake
- Unity Catalog
- MLflow
- Databricks Workflows
- Model Serving / Feature Store (preferred)
- Strong programming experience in Python, PySpark, SQL, and AI/ML solution development.
- Solid experience in designing and deploying Machine Learning pipelines in production.
- Good understanding of MLOps / LLMOps, including model versioning, CI/CD, deployment, monitoring, and governance.
- Experience with cloud platforms such as Azure, AWS, or GCP, preferably with Databricks integration.
- Familiarity with Generative AI / LLM ecosystems, such as OpenAI, Hugging Face, LangChain, vector stores, embeddings, and RAG architectures.
- Strong understanding of data engineering, ETL/ELT, distributed computing, and data platform modernization.
- Experience in solution architecture, technical governance, and stakeholder engagement.
Top Skills
Ai Solutions
AWS
Azure
Data Engineering
Databricks
GCP
Generative Ai
Hugging Face
Lakehouse Architecture
Langchain
Llm Ecosystem
Machine Learning
Openai
Python
Spark
SQL
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Corporate Account Executive drives new business acquisition, manages sales cycles, collaborates with partners, and ensures exceptional customer service within the cybersecurity sector.
Top Skills:
Ai-Native PlatformsCybersecurity
Cloud • Information Technology • Security • Software • Cybersecurity
Lead Zscaler's growth in the APJ public sector, guiding government officials on cybersecurity strategies and compliance with data sovereignty laws.
Top Skills:
Cloud SecurityCybersecurity SolutionsData ResidencyZero Trust Architecture
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Ad & Media Ops Manager oversees digital advertising operations across the APAC region, ensuring compliance with global standards, managing regional campaigns, and collaborating with agencies for technical support and data governance.
Top Skills:
Adobe Advertising CloudCampaign ManagerDv360Google AdsGoogle Marketing PlatformLinkedin Campaign ManagerThe Trade Desk
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
