Optimize and compress large language and vision models for on-device inference. Develop distillation and hardware-specific compilation pipelines, deploy models to edge devices, and benchmark performance across NPU/GPU architectures to ensure efficient on-device operation.
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.
Responsibilities:
- Compress and optimize large language and vision models for on-device inference.
- Develop pipelines for model distillation and hardware-specific compilation.
- Benchmark performance across various NPU/GPU architectures.
Qualifications:
- Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
- Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
- Strong C++ and Python skills.
Similar Jobs
Agency • Artificial Intelligence • Blockchain • Web3
Perform adversarial testing and red-teaming on large language and multimodal models, implement runtime guardrails and filtering, and help develop constitutional AI principles and RLHF alignment pipelines to ensure safe AI deployment.
Top Skills:
Adversarial MlConstitutional AiJailbreak TaxonomiesLlmsMultimodal AgentsPrompt EngineeringRed-Teaming FrameworksRlhf
Artificial Intelligence • Big Data • Healthtech • Machine Learning • Software • Database • Analytics
Leads InterSystems’ Australia and New Zealand business, owning regional sales strategy, revenue growth, customer relationships, partnerships, and P&L accountability. Manages sales and sales engineering teams, develops business plans and KPIs, engages senior executives, coordinates cross-functional resources, expands the customer base, and ensures customer success. The role requires extensive regional travel, enterprise software expertise, strong technical selling skills, and the ability to lead through influence across a multinational organization.
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and refine core AI and machine learning infrastructure supporting model development, training, evaluation, deployment, and monitoring. Design scalable distributed ML systems, collaborate with product and engineering teams, lead projects from technical design through launch, review code, document solutions, resolve infrastructure challenges, and mentor junior engineers.
Top Skills:
AWSAzureCi/CdDaskGCPGoGpusJavaJaxLarge Language Models (Llms)MlopsPythonPyTorchRayRetrieval-Augmented Generation (Rag)ScalaSparkTensorFlow
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
