Optimize and compress large language and vision models for on-device inference. Develop distillation and hardware-specific compilation pipelines, deploy models to edge devices, and benchmark performance across NPU/GPU architectures to ensure efficient on-device operation.
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.
Responsibilities:
- Compress and optimize large language and vision models for on-device inference.
- Develop pipelines for model distillation and hardware-specific compilation.
- Benchmark performance across various NPU/GPU architectures.
Qualifications:
- Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
- Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
- Strong C++ and Python skills.
Similar Jobs
Agency • Artificial Intelligence • Blockchain • Web3
Perform adversarial testing and red-teaming on large language and multimodal models, implement runtime guardrails and filtering, and help develop constitutional AI principles and RLHF alignment pipelines to ensure safe AI deployment.
Top Skills:
Adversarial MlConstitutional AiJailbreak TaxonomiesLlmsMultimodal AgentsPrompt EngineeringRed-Teaming FrameworksRlhf
Cloud • Security • Software • Cybersecurity • Automation
Serve as a technical pre-sales advisor for ANZ customers: lead discovery, demos, POCs/POVs and workshops; design solutions using GitLab, DevSecOps and cloud practices; influence adoption and revenue; provide customer feedback to product teams and create reusable technical collateral.
Top Skills:
AICi/CdCloud ComputingCollaboration PlatformsContinuous DeploymentContinuous IntegrationDevsecopsGitGitlabSource Control
Cloud • Information Technology • Security • Software • Cybersecurity
Act as a quota-bearing technical trusted advisor for enterprise customers: lead technical discovery, design bespoke architectures, deliver demos/PoCs across security, networking, Zero Trust and developer platforms, drive adoption/expansion, run technical QBRs, and leverage AI-augmented workflows to automate routine tasks.
Top Skills:
AuthenticationAWSAzureBashBgpCdnCloudflare Ai GatewayCloudflare Workers AiDdos MitigationDlpDnsEssential EightFirewallsForward ProxyGCPGdprGoGreHipaaHTTPIdentity ManagementIpv4Ipv6IrapIso/IecJavaScriptLlmMplsPci DssPrompt EngineeringPythonRagReverse ProxySaseSd-WanSecure Web GatewayServerlessSoc-2TcpTlsTraffic ManagementUdpVpnWafZtna
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
