Lead and grow a compiler, kernel, and runtime engineering team responsible for accelerator bring-up across the Modular stack. Drive technical direction, architecture, coding, roadmap delivery, vendor partnerships, SOWs, milestones, cross-team dependencies, hiring, and production-quality model deployment across diverse hardware platforms.
About Modular
About Modular:
About the Role:
What you will do:
What you Bring to the table:
Helpful, but not required:
What Modular brings to the table:
At Modular, we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team, made up of industry leaders and experts, is building cutting-edge, modular infrastructure that simplifies AI development and deployment. By rethinking the complexities of AI systems, we’re empowering everyone to unlock AI’s full potential and tackle some of the world’s most pressing challenges.
If you’re passionate about shaping the future of AI and creating tools that make a real difference in people’s lives, we want you on our team. You can read about our culture and careers to understand how we work and what we value.
Modular is building the next generation of AI infrastructure, bringing together programming languages, compilers, runtimes, frameworks, and developer tools to make AI development faster, more portable, and more accessible.
At the center of this work are Mojo, our systems programming language designed for the AI era, and MAX, our unified AI platform. Together, they enable developers to build and deploy high-performance AI workloads across CPUs, GPUs, and next-generation AI accelerators.
As part of our mission to build AI's unified compute layer, we're expanding the Modular software stack across a growing range of hardware platforms. Our goal is to give developers a consistent programming and deployment experience while enabling differentiated hardware architectures through a unified software stack.
ML developers today face significant friction when taking trained models into deployment. The ecosystem remains fragmented, with incomplete and patchwork solutions that often require significant performance tuning and model-specific optimization.
At Modular, we're building a unified AI platform designed to radically improve how developers build, optimize, and deploy AI models across heterogeneous hardware.
We're looking for an Engineering Manager to lead the Hardware Bringup team and own the end-to-end delivery of new accelerator platforms across the Modular stack — from Mojo kernels and compiler infrastructure through the graph compiler, runtime, and MAX model serving.
This is a hands-on engineering management role. You'll partner closely with the Hardware Bringup Architect and Head of Mojo to establish technical direction and team priorities while leading a multidisciplinary group of compiler, kernel, and runtime engineers.
You'll be accountable not only for the team's technical execution, but also for coordinating multiple concurrent hardware partnerships, aligning cross-functional stakeholders, managing dependencies and risk, and delivering against ambitious external commitments.
You'll also work directly with hardware partners and participate in technical design reviews and pre-sales discussions. A critical part of the role will be translating engineering plans into credible Statements of Work (SOWs), milestones, acceptance criteria, staffing plans, and delivery schedules — and ensuring the team executes against those commitments.
This role is ideal for an engineering leader who wants to remain technically close to the work while building a high-trust team capable of bringing entirely new hardware platforms from initial viability through production-quality AI deployment.
LOCATION: US/Canada, US/Canada/Europe, and San Francisco Bay Area. Depending on the final approved location policy, candidates may have access to our Los Altos, CA office or remote flexibility. Onboarding for new hires is conducted in person at our Los Altos, CA office.
- Lead, mentor, and grow a multidisciplinary Hardware Bringup team of approximately 2–7 engineers spanning compiler, kernel, and runtime engineering.
- Partner with the Hardware Bringup Architect to establish the team's technical direction, architecture, priorities, and execution roadmap across multiple accelerator platforms.
- Own the end-to-end delivery of hardware enablement programs, from initial platform evaluation and development-environment bringup through compiler integration, kernel development, runtime support, MAX serving, and production-quality model deployment.
- Remain technically hands-on by participating in architecture and design reviews, reviewing code, contributing to prototypes where appropriate, and helping unblock the team's most difficult technical challenges.
- Maintain enough technical depth across areas such as Mojo kernels, MLIR/LLVM, compiler lowering, runtime integration, and accelerator programming to credibly evaluate designs and guide engineering decisions.
- Scope Statements of Work (SOWs) with hardware partners, translating technical plans into milestones, acceptance criteria, staffing requirements, dependencies, and delivery schedules.
- Manage execution against external and commercial commitments, identifying risks early, negotiating scope and timelines when necessary, and ensuring stakeholders have a clear view of project health.
- Work directly with hardware vendor engineering teams throughout platform bringup, including technical planning, integration, issue escalation, milestone reviews, and delivery.
- Partner across Kernels, Graph Compiler, MAX, Cloud, and other Modular teams to align roadmaps, resolve cross-team dependencies, and develop credible staffing and execution plans.
- Participate in technical pre-sales and partner discussions, helping evaluate platform feasibility, engineering requirements, timelines, and integration complexity.
- Hire and develop exceptional engineers in partnership with the Head of Mojo, including defining hiring profiles, participating in interview loops, calibrating talent, and helping close senior candidates.
- Create an environment where engineers can take meaningful ownership while maintaining clear accountability around technical quality, timelines, and externally committed milestones.
- Foster a write-things-down, demo-driven engineering culture, ensuring knowledge about new architectures — including ISAs, memory hierarchies, execution models, and vendor toolchains — is captured and shared across the organization.
- 7+ years of industry experience in compiler engineering, high-performance computing, kernel development, accelerator software, systems engineering, or a closely related technical domain.
- 2+ years of engineering management or technical team leadership experience, with strong IC-to-manager transitions welcome.
- Strong technical foundations in compilers, systems software, accelerator programming, or hardware/software integration, with the depth necessary to lead a highly technical engineering team.
- The ability and willingness to remain hands-on enough to participate meaningfully in architecture discussions, design reviews, technical debugging, prototypes, and code reviews.
- Strong proficiency in C++ and experience working in complex, multi-component production software systems.
- Hands-on experience with at least one heterogeneous programming environment such as CUDA, SYCL, OpenCL, or a comparable accelerator programming model.
- Experience leading technically complex projects that cross multiple layers of a software stack or involve significant hardware/software integration.
- A demonstrated track record of delivering multi-quarter engineering roadmaps with complex dependencies, including managing scope, staffing, risk, timelines, and external commitments.
- Experience working directly with hardware vendor engineering teams through joint bringup, integration, partner escalations, or other vendor-facing technical programs.
- Experience scoping, negotiating, or delivering engineering commitments under SOWs, joint engineering plans, or comparable formal agreements.
- Strong people leadership skills, including experience developing engineers, setting expectations, providing feedback, building team trust, and maintaining a high technical bar.
- Strong written and verbal communication skills, with the ability to communicate effectively with engineers, executives, commercial stakeholders, and external partners.
- Ability to operate effectively in ambiguity, establish priorities across competing demands, and create clarity for both engineers and stakeholders.
- A collaborative leadership style and an ability to work effectively across compiler, kernel, runtime, product, business, and hardware-partner organizations.
- Experience leading software bringup for non-GPU accelerators, including DSPs, NPUs, custom ASICs, or other novel compute architectures.
- Contributor-level familiarity with MLIR or LLVM compiler infrastructure.
- Background in AI compilers, high-performance kernel libraries, or GPU programming abstractions such as Triton, CUTLASS, or CuTe.
- Familiarity with how important AI operators are implemented and optimized at a low level, including custom kernels, fused operators, memory movement, or framework-level integration.
- Experience with hardware architecture concepts such as ISAs, memory hierarchies, synchronization models, data movement, and execution models.
- Experience debugging correctness or performance problems across kernels, compiler lowering, runtime behavior, and physical hardware.
- Experience drafting, negotiating, or executing engineering SOWs with hardware vendors, cloud providers, or other strategic technology partners.
- Experience participating in technical pre-sales, customer engagements, or commercial discussions involving complex engineering deliverables.
- Exposure to model serving and inference optimization at production scale.
- Experience managing multiple simultaneous hardware partnerships or platform-enablement programs.
- Experience building or scaling a multidisciplinary engineering team spanning areas such as compilers, kernels, runtimes, and hardware enablement.
- Amazing Team. We are a progressive and agile team with some of the industry's best engineering and product leaders. You'll lead engineers working across compilers, kernels, runtimes, AI infrastructure, and emerging accelerator architectures.
- End-to-End Technical Ownership. You'll have the opportunity to lead hardware programs from their earliest technical exploration through production AI deployment, rather than owning only one layer of the enablement stack.
- Engineering Leadership with Technical Depth. This is an opportunity to build and lead a team while remaining close to architecture, design, and some of the hardest hardware/software problems in the organization.
- Hardware Ecosystem Impact. You'll work directly with hardware partners and help determine how new accelerator architectures become first-class targets across the Modular platform.
- World-class Benefits. In order to attract the best, we need to offer the best. Premier insurance plans, up to 5% 401k matching, flexible paid time off, and more are available to you! Please note that specific benefit packages may vary based on your location.
- Competitive Compensation. We offer very strong compensation packages and want people to be focused on their best work. We believe in tailoring compensation plans to meet the needs of our workforce.
- Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as other cities. Traveling 2–4 times a year is expected for all roles.
Working at Modular will enable you to grow quickly as you work alongside incredibly motivated and talented people who have high standards, possess a growth mindset, and share a purpose to fundamentally change how software is built for AI and accelerated computing.
The estimated base salary range for this role to be performed in the US, regardless of the state, is $261,000–$330,000 USD.
The estimated base salary range for this role to be performed in Canada, regardless of the province, is $256,000–$323,000 CAD.
The estimated base salary range for this role to be performed in Edinburgh is $172,000–$191,000 €.
The salary for the successful applicant will depend on a variety of permissible, non-discriminatory job-related factors, which include but are not limited to education, training, work experience, business needs, or market demands. This range may be modified in the future. The total compensation for a candidate will also include annual target bonus, equity, and benefits, with equity making up a significant portion of total compensation.
For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply, as we may have openings at lower or higher levels than the one advertised.
Similar Jobs
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Manages strategic, transformational, and cross-functional projects from planning through go-live. Responsibilities include coordinating teams and vendors, managing budgets, timelines, quality, testing, resources, risks, reporting, governance, and operational readiness. The role also mentors project managers, leads stakeholder meetings, and drives consistent project delivery across multiple regions.
Top Skills:
MS Office
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Lead quality assurance for medical devices and combination products across development and sustaining lifecycles. Provide risk-based design control and quality system oversight, review complaint investigations, support post‑market activities, partner with cross‑functional teams, and drive process improvements to ensure regulatory compliance and patient safety.
Top Skills:
21 Cfr 82021 Cfr Part 4GmpIso 13485Iso 14971
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Lead design, delivery and maintenance of GMP/GDP audit strategy for biologics, aseptic, small molecule and medical device areas. Plan and execute complex audits, coach auditors, analyze regulatory intelligence, drive corrective actions, support inspection readiness, and partner with PGS/PharmSci and site stakeholders to ensure compliance and continuous improvement.
Top Skills:
Aseptic ManufacturingDigital HealthEu DirectiveFdaGdpGmpIchIsoMedical Device RegulationsPic/SQuality Management SystemSoftware As A Medical Device (Samd)Tga
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
