Responsible for developing AI search agents and RAG pipelines, optimizing performance, and monitoring production environments while ensuring accuracy and efficiency.
Job Responsibilities
1. Building AI search agents- including ReAct, planning, and multi-agent architectures via custom implementation or frameworks like LangGraph, Dify, or CrewAI.
2. Building end-to-end RAG pipelines from ingestion, chunking, embeddings, and hybrid vector search, ideally using Opensearch.
3. Operating and monitoring vector/hybrid indexes (e.g. OpenSearch) in production environments.
4. Implement grounding and citation to link generated answers back to their exact source passages.
5. Automate evaluation using synthetic QA, retrieval-hit-rate tracking, and model-critique loops to continuously measure accuracy and detect drift.
6. Orchestrating external tools or knowledge bases and monitoring latency and cost at production scale.
Qualifications
1. Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
2. 3+ years of experience in developing AI systems, with a focus on retrieval-augmented generation (RAG).
3. Proven track record in building and optimizing end-to-end RAG pipelines.
4. Experience with AI search agent development using frameworks like ReAct, LangGraph, Dify, or CrewAI.
5. Hands-on experience with OpenSearch or similar vector search technologies.
6. Proficiency in Python and relevant machine learning frameworks (e.g., PyTorch, TensorFlow).
7. Strong understanding of data ingestion, chunking, embeddings, and hybrid vector search techniques.
8. Experience with monitoring and managing production environments.
9. Knowledge of grounding and citation techniques in AI-generated content.
10. Familiarity with synthetic QA datasets and evaluation metrics.
Top Skills
Crewai
Dify
Langgraph
Opensearch
Python
PyTorch
TensorFlow
Similar Jobs
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
The Senior Deep Learning Scientist will develop advanced deep learning signals for risk management, conducting experiments and applying ML breakthroughs to enhance financial products.
Top Skills:
AWSGCPKerasMySQLNumpyPandasPythonPyTorchSklearnSnowflakeSparkTensorFlowXgboost
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
As Product Lead for Controls, you will develop customer trust through effective management of Cash App's restrictions, leading a full stack team to optimize user experiences and drive strategic initiatives.
Top Skills:
Financial ProductsPlatform InfrastructureProduct Management Tools
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
The Senior Deep Learning Scientist will lead experiments and research on advanced deep learning and reinforcement learning for risk management, collaborating with various teams and applying innovative ML solutions.
Top Skills:
AWSGCPKerasMySQLNumpyPandasPythonPyTorchSklearnSnowflakeSparkTensorFlowXgboost
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
