Zendesk Logo

Zendesk

Staff Machine Learning Engineer

Posted 4 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in New South Wales, AUS
Senior level
In-Office or Remote
Hiring Remotely in New South Wales, AUS
Senior level
Design, implement, and harden production LLM agent execution: planning loop, tool dispatch, memory, retrieval, connectors, retries/timeouts, and security. Improve retrieval latency/cost, instrument executions for training data, and collaborate with Product Security and ML teams to ship reliable systems at scale.
The summary above was generated by AI
Job Description

What we have built

The Custom Agent Service handles the full agent lifecycle: an admin configures an agent with instructions, knowledge articles, and actions through a UI; a customer ticket triggers execution; the agent plans, acts through real APIs via the Integration Action Platform, and resolves the issue. The backend is Python, the infrastructure is Kubernetes on AWS, and the agent architectures range from single-pass ReAct loops to our iterative multi-plan executor.


We are onboarding our first internal and external EAP customers, so the work ships to real accounts with real tickets.

What we need help with

Agent execution core. The planning loop, tool dispatch, memory integration, and error recovery that make up the main execution path. You will work directly on the code that decides what the agent does next and make it faster, more reliable, and more capable. This includes integrating new architectures into the production path and hardening them for real traffic.


Knowledge retrieval. Agents retrieve and reason over customer knowledge bases at runtime. The retrieval pipeline (embedding, reranking, context assembly) needs to balance answer quality against latency and token cost, across thousands of heterogeneous knowledge bases per deployment.


Actions and connectors. Agents call Zendesk APIs, third-party connectors (Shopify, Salesforce, etc.), custom actions configured by admins, and increasingly other agents via A2A. The execution layer needs reliable retries, timeouts, schema validation, and graceful degradation when connectors fail mid-execution. You would also self-service new connector integrations through the Connector SDK.


Production instrumentation for model training. Every agent execution generates a trajectory (reasoning steps, tool calls, outcomes, user feedback). We are building toward training domain-specialized models, and that requires clean production data. You would instrument the execution pipeline to capture implicit reward signals (resolution success, escalation patterns, user satisfaction) that feed into the ML team's training pipeline.


Security and compliance. PII filtering, audit logging, action versioning, and governance patterns that keep agents within admin-configured bounds. You would work directly with Product Security on security review items as the platform scales.

What we are looking for
  • 5+ years of backend engineering with strong Python skills. You have shipped production systems, not just models. You understand the difference between getting an agent to work locally and running it across 100,000 accounts.
  • Comfortable across the full agent stack: LLM APIs, prompt engineering, tool calling, memory management, evaluation. You can build an agent loop from scratch, and you know when a framework helps vs. when it gets in the way.
  • You think about what happens when the model returns garbage, the connector times out, and the customer is waiting. You build for the failure case, not just the happy path.
  • You ship working code, review PRs carefully, and communicate clearly about what is done, what is blocked, and what is at risk.
Tech Stack
  • Languages: Python (primary), some Go for platform services
  • Agent Frameworks: Custom iterative architectures, ReAct, with integration points to open-source tooling
  • Infrastructure: Kubernetes, Spinnaker, AWS (ECS, S3, ElastiCache)
  • Data: Postgres, ElastiCache/Redis (vector + KV), Kafka
  • Evaluation: Braintrust (experiment tracking, scoring, CI/CD integration)
  • Protocols: MCP, REST, gRPC

Why Zendesk for this work

Zendesk has 100,000+ customers, billions of support interactions, and a live product surface where agents are already resolving tickets. The feedback loop from an agent action to a measurable customer outcome is minutes, not months. We are hiring 2+ engineers at each of these levels.

The intelligent heart of customer experience

Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love.

Zendesk believes in offering our people a fulfilling and inclusive experience. Our hybrid way of working, enables us to purposefully come together in person, at one of our many Zendesk offices around the world, to connect, collaborate and learn whilst also giving our people the flexibility to work remotely for part of the week.

As part of our commitment to fairness and transparency, we inform all applicants that artificial intelligence (AI) or automated decision systems may be used to screen or evaluate applications for this position, in accordance with Company guidelines and applicable law.

Zendesk is an equal opportunity employer, and we’re proud of our ongoing efforts to foster global diversity, equity, & inclusion in the workplace. Individuals seeking employment and employees at Zendesk are considered without regard to race, color, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, disability, military or veteran status, or any other characteristic protected by applicable law. We are an AA/EEO/Veterans/Disabled employer. If you are based in the United States and would like more information about your EEO rights under the law, please click here.

Zendesk endeavors to make reasonable accommodations for applicants with disabilities and disabled veterans pursuant to applicable federal and state law. If you are an individual with a disability and require a reasonable accommodation to submit this application, complete any pre-employment testing, or otherwise participate in the employee selection process, please send an e-mail to [email protected] with your specific accommodation request.

Similar Jobs

15 Hours Ago
In-Office or Remote
Sydney, New South Wales, AUS
Senior level
Senior level
Digital Media • Information Technology • Software • Design
Lead design, implementation, and productionization of large-scale recommender systems. Integrate research into models, run online/offline experiments, improve ML architecture and serving, collaborate with cross-functional teams, and mentor engineers.
Top Skills: Ml Training PipelinesModel ServingNumpyPandasPythonPyTorchRecommender SystemsScikit-Learn
15 Hours Ago
In-Office or Remote
Sydney, New South Wales, AUS
Senior level
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Individual contributor owning partner marketing for Australia. Build and localize global playbooks, execute joint campaigns across events, digital, content and enablement, track performance, drive leads, self-onboards and product attach, and manage industry, retail and supplier partnerships to amplify growth.
Yesterday
In-Office or Remote
Australia
Mid level
Mid level
Artificial Intelligence • Legal Tech • Software
Select the world’s best golf-playing practicing lawyer to attend the Legora Invitational in NYC on Sept 2, 2026. Play golf with leading lawyers and Ludvig Åberg, present a written, specific case about how you use Legora, demonstrate putting ability, and join discussions about the future of law and legal technology. Travel and accommodation covered.

What you need to know about the Sydney Tech Scene

From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account