Senior Compiler Engineer – AI

NVIDIA

. Design and implement program transformations on JAX programs (jaxpr) for large-scale training, including pipeline schedules, task placement, sharding, and communication/computation overlap .

Posted 11/3/2026full-timeRemote • United StatesSenior💰 $184,000 - $287,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in Compiler Design and Implementation, Distributed System Development, and Deep Learning Frameworks, particularly JAX and PyTorch. Proficient in GPU Training and Inference, with strong software design skills and the ability to lead complex projects independently.

Highest-signal resume keywords

Compiler Design And ImplementationDistributed System DevelopmentDeep Learning Frameworks (JAX, PyTorch)C/C++ And Python ProgrammingGPU Training And Inference

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Compiler DesignDistributed System DesignDeep Learning FrameworksC/C++ ProgrammingPython ProgrammingGPU TrainingPerformance AnalysisParallel Computing Libraries (MPI)CUDA ProgrammingPipeline Parallelism

Soft Skills

Strong Communication SkillsIndependent WorkProject Goal DefinitionLeadership

Tools & Technologies

JAXXLANCCLNVSHMEMRDMAMaxTextJaxPPStableHLOMLIR

Industry Keywords

Deep LearningLarge-Scale TrainingOpen-Source ContributionsMachine Learning ProjectsGPU Architecture

Tech Stack

Tools & technologies

Distributed SystemsPythonPyTorchC++

About the role

Key responsibilities & impact

Design and implement program transformations on JAX programs (jaxpr) for large-scale training, including pipeline schedules, task placement, sharding, and communication/computation overlap
Develop optimizing compiler and runtime technologies for accelerating deep learning training on large-scale distributed systems
Compile graph intermediate representations to target-specific code
Build distributed runtimes that dispatch per-stage programs to many GPUs and move data between stages using communication libraries such as NCCL
Advance compiler technology for high-performance large-scale training workloads, including mixture-of-experts models
Collaborate with JAX, XLA, and hardware architecture teams
Integrate JaxPP into JAX training frameworks, including MaxText
Contribute to the open-source JaxPP project through maintenance, testing, performance tracking, and adoption support

Requirements

What you’ll need

Master's or PhD in Computer Science, Computer Engineering, or related field, or equivalent experience
6+ years of relevant work or research experience in compilers, distributed systems, or deep learning training
Compiler design and implementation
Distributed system design, development, and deployment
Experience with deep learning frameworks (JAX, PyTorch)
GPU training and inference of deep learning models
C/C++ and Python programming
Excellent software design skills, including debugging, performance analysis, and test design
Experience with parallel computing libraries (MPI)
Ability to work independently, define project goals and scope, and lead development efforts
Strong communication skills
Experience with JAX internals, XLA, StableHLO, or MLIR is advantageous
Experience building or tuning large training jobs with pipeline, tensor, expert, and data parallelism is advantageous
Knowledge of GPU communication libraries such as NCCL, NVSHMEM, or RDMA, and CPU and/or GPU architecture is advantageous
CUDA programming experience is a plus
Contributions to open-source compiler or machine learning projects are advantageous
Experience mentoring early career engineers and interns is a bonus

Benefits

Comp & perks

Equity
Benefits package
Competitive salary