Product Manager – Inference Experience

Baseten

. Own product strategy and roadmap across Baseten's inference offerings, focusing on developer adoption and business impact .

Posted 11/11/2026full-timeUnited StatesSeniorLead💰 $200,000 - $400,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive experience in building and shipping AI/ML products, with a strong technical background in software engineering and ML engineering. Capable of leading cross-functional initiatives and translating technical capabilities into developer-friendly products and measurable business impact.

Highest-signal resume keywords

10+ Years AI/ML Product ExperienceModel Serving ExpertisePyTorch Framework ProficiencyCross-Functional LeadershipDeveloper Product Instincts

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI/ML Product DevelopmentModel DeploymentInfrastructure BuildingTechnical StrategyModel Evaluation

Soft Skills

Exceptional CommunicationCustomer EngagementCollaborative Problem-Solving

Tools & Technologies

PyTorchTensorRT-LLMVLLMSGLangNVIDIA Dynamo

Industry Keywords

Developer AdoptionProduct RoadmapGTM CollaborationModel APIsGPU Economics

Tech Stack

Tools & technologies

PyTorch

About the role

Key responsibilities & impact

Own product strategy and roadmap across Baseten's inference offerings, focusing on developer adoption and business impact
Make it easier for developers to discover, evaluate, deploy, and manage AI models through APIs, SDKs, CLI, and console
Work with inference engineers and researchers to turn technical advances into customer-facing capabilities
Help determine which models, workloads, and customer needs to prioritize
Partner with GTM and leadership on pricing, packaging, launches, and commercialization
Spend time with developers and customers to understand needs and inform product development
Shape products including Model APIs, Dedicated Inference, Model Evaluations, and the Model Library

Requirements

What you’ll need

10+ years building and shipping AI/ML products or platforms
A technical background in software engineering, ML engineering, research, or equivalent hands-on experience
Direct experience building or deploying models using technologies like PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo, or similar frameworks
Strong understanding of model serving, GPU economics, and the tradeoffs between quality, latency, throughput, and cost
Exceptional developer product instincts
A track record of leading cross-functional product initiatives and turning technical capabilities into measurable adoption or revenue growth
Experience deploying models, building infrastructure products, building ML infrastructure, or designing tools used from both a terminal and a console (nice to have)
Past experience as a software developer (nice to have)

Benefits

Comp & perks

Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities