AI Framework Engineer

Modular

. Develop the API surface for MAX, including namespaces, core abstractions, extension points, programming model, compatibility guarantees, and developer experience .

Posted 11/8/2026full-timeLos Altos • California • United StatesJunior💰 $120,000 - $222,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing APIs for modern AI frameworks, with a strong focus on Python and Mojo. Capable of designing developer-facing solutions while ensuring high standards of API ergonomics and technical documentation.

Highest-signal resume keywords

API DevelopmentPython ProgrammingMojo FamiliarityAI Frameworks KnowledgeTechnical Specification Writing

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

API DesignProgramming LanguagesC++ ProficiencyRust ProficiencyDistributed SystemsModel LoadingQuantizationBatchingCheckpointingObservability

Soft Skills

Strong Written CommunicationCollaborationFeedback Iteration

Tools & Technologies

PyTorchJAXTensorFlowVLLMXLAMLIR

Industry Keywords

Software EngineeringDeveloper ExperienceEngineering StandardsIncremental Development

Tech Stack

Tools & technologies

CloudPythonPyTorchRustTensorflowC++Go

About the role

Key responsibilities & impact

Develop the API surface for MAX, including namespaces, core abstractions, extension points, programming model, compatibility guarantees, and developer experience
Design and develop inference APIs for model loading, distributed inference, quantization, tokenization/pipelines, configuration, batching/streaming, and deployment
Develop training APIs supporting single-device through distributed execution, including device placement, parallelism, checkpointing, and observability
Create a coherent programming model across Python and Mojo-adjacent surfaces
Write and socialize technical RFCs and specifications, gather feedback, and iterate toward consensus
Partner with compiler/runtime, kernels, cloud/serving, and documentation/DevRel teams
Develop reference implementations, golden-path examples, architecture templates, and best-practice patterns

Requirements

What you’ll need

Candidates based in the US are welcome to apply
Bachelor's degree in Engineering, Information Systems, Computer Engineering, Electrical Engineering, Computer Science, or related field and 2+ years of Software Engineering or related work experience; OR Master's degree in a relevant field and 1+ year of Software Engineering or related work experience; OR PhD in a relevant field
1+ year of academic or work experience with a Programming Language such as Python, Mojo, Rust, C++, etc.
Passion for designing developer-facing APIs (SDKs, frameworks, or platforms)
Good understanding of modern AI frameworks and their design tradeoffs, including PyTorch, JAX, TensorFlow, vLLM, and XLA/MLIR-adjacent ecosystems
Proficiency in one or more systems/performance languages: C++, Rust, or Go
Proficiency in one or more user-facing languages: Python; familiarity with Mojo is a plus
Strong API ergonomics instincts covering naming, composability, types, error handling, configurability, and clarity
Strong written communication and ability to write unambiguous technical specifications
Passion for engineering standards, pragmatism, and incremental development without compromising long-term design

Benefits

Comp & perks

Comprehensive healthcare coverage
Retirement and savings programs
Employee stock purchase opportunities
Paid time off
Wellbeing resources
Family support programs
Learning and development opportunities
RSU grants
Relocation assistance for out-of-state candidates based in the US
Regular team onsites and local meetups
Team travel 2-4 times a year