Senior Technical Program Manager, AI Inference

NVIDIA

. Drive planning, scheduling, dependency tracking, and executive reporting across multiple concurrent inference programs .

Posted 10/23/2026full-timeRemote • California • United StatesSenior💰 $168,000 - $322,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in leading global technical programs, with a strong focus on program lifecycle management, agile practices, and effective communication across technical and business domains. Proficient in machine learning, AI infrastructure, and program tracking tools to enhance delivery quality and team efficiency.

Highest-signal resume keywords

Program ManagementAgile PracticesMachine LearningAI InfrastructureScaled Agile Frameworks

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Program Tracking ToolsSoftware Engineering MethodologiesHardware Bring-Up ProcessesEnterprise Quality StandardsProduction AI Software DeliveryModel Optimization ToolingInference FrameworksDependency TrackingMetrics DevelopmentRisk Management

Soft Skills

Clear CommunicationCoachingConflict ResolutionModeration of Technical DiscussionsCross-Disciplinary Collaboration

Certifications & Qualifications

BS Degree in Computer ScienceBS Degree in Artificial Intelligence

Industry Keywords

Technical Program LeadershipGlobal TeamsDelivery QualityTeam EfficiencyEngineering Organizations

About the role

Key responsibilities & impact

Drive planning, scheduling, dependency tracking, and executive reporting across multiple concurrent inference programs
Partner with hardware and software engineering leads to align library development with new and upcoming hardware timelines
Coach teams on agile practices and run the rituals that keep programs on track
Build and maintain metrics that surface risks early and support decisions with real data
Communicate program status and technical context clearly to engineering teams and senior leadership alike
Align global, cross-disciplinary teams spanning hardware, software, and product
Identify process gaps and implement improvements that increase delivery quality and team efficiency
Moderate complex technical discussions and drive them to clear, documented conclusions
Own the full program lifecycle from initial planning through delivery

Requirements

What you’ll need

BS degree in Computer Science, Artificial Intelligence, or equivalent experience
10 years of experience leading global technical programs
Solid knowledge of software engineering standard methodologies, hardware bring-up processes, and enterprise quality standards
Proficiency with Scaled Agile frameworks and program tracking tools
Demonstrated ability to resolve resource conflicts, unblock teams, and drive alignment at every level of the organization
Clear, compelling communication skills across both technical and business audiences
Proven experience in machine learning, deep learning, GPU technology, or AI infrastructure
Experience shipping production AI software or co-managing software-hardware programs end to end
A record of building scalable program management practices in growing engineering organizations
Familiarity with open-source inference frameworks or model optimization tooling

Benefits

Comp & perks

Equity
Benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score