Senior AI Framework Engineer

Modular

. Influence the design of MAX API namespaces, core abstractions, extension points, programming model, compatibility guarantees, and developer experience .

Posted 11/5/2026full-timeLos Altos • California • United StatesSenior💰 $180,000 - $324,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and evolving developer-facing APIs, with a strong understanding of modern AI frameworks and their design tradeoffs. Proficient in systems and user-facing programming languages, with a focus on API ergonomics and technical specification writing.

Highest-signal resume keywords

API DesignModern AI FrameworksC++PythonTechnical Specification Writing

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

API DesignInference SystemsTraining SystemsModel Execution GraphsPerformance TuningC++RustGoPythonMojo

Soft Skills

Written CommunicationPragmatismIncremental Development

Tools & Technologies

PyTorchJAXTensorFlowVLLMXLAMLIR

Industry Keywords

Developer-Facing APIsSDKsFrameworksPlatformsDistributed Execution

Tech Stack

Tools & technologies

CloudPythonPyTorchRustTensorflowC++Go

About the role

Key responsibilities & impact

Influence the design of MAX API namespaces, core abstractions, extension points, programming model, compatibility guarantees, and developer experience
Design inference APIs for model loading, distributed inference, quantization, tokenization/pipelines, configuration, batching/streaming, and deployment
Design training APIs for single-device and distributed execution, device placement, parallelism, checkpointing, and observability
Create a coherent programming model across Python and Mojo-adjacent surfaces
Drive RFCs and technical specifications, gather feedback, and iterate toward consensus
Partner with compiler/runtime, kernels, cloud/serving, and documentation/DevRel teams
Build reference implementations, golden-path examples, architecture templates, and best-practice patterns
Set API quality standards for versioning, deprecation, testing, and documentation

Requirements

What you’ll need

Significant experience designing and evolving developer-facing APIs (SDKs, frameworks, or platforms)
Strong understanding of modern AI frameworks and their design tradeoffs, including PyTorch, JAX, TensorFlow, vLLM, and XLA/MLIR-adjacent ecosystems
Experience with inference and training systems, including model execution graphs, compilation, runtime scheduling, distributed execution, checkpointing, and performance tuning
Fluency in one or more systems/performance languages: C++, Rust, or Go
Fluency in one or more user-facing languages: Python; familiarity with Mojo is a plus
Excellent API ergonomics, including naming, composability, types, error handling, configurability, and clarity
Strong written communication and ability to write unambiguous technical specifications
High engineering standards, pragmatism, and bias toward incremental development
Candidates must be based in the US or Canada
Willingness to attend in-person onboarding in Los Altos, CA
Expected to travel 2–4 times a year

Benefits

Comp & perks

Comprehensive healthcare coverage
Retirement and savings programs
Employee stock purchase opportunities
Paid time off
Wellbeing resources
Family support programs
Learning and development opportunities
RSU grants
Annual target bonus
Regular team onsites and local meetups
Travel 2–4 times a year
Remote work from home option
In-person onboarding in Los Altos, CA