Data Scientist, Inference Capacity Optimization

OpenAI

. Build statistical and machine learning models to profile and improve GPU utilization, latency, throughput, and overall fleet efficiency .

Posted 9/16/2026full-timeSan Francisco • California • United StatesMid-LevelSenior💰 $293,000 - $325,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building statistical and machine learning models for optimizing GPU utilization and capacity planning. Proficient in communicating analytical insights to executive leadership and collaborating across teams to align compute planning with business objectives.

Highest-signal resume keywords

PythonSQLForecasting ModelsCapacity PlanningStatistical Inference

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Statistical ModelsMachine Learning ModelsOptimization ModelsPredictive ModelsTime-Series ForecastingCausal AnalysisReinforcement LearningCost OptimizationQueueing TheoryOperations Research

Soft Skills

CommunicationCollaboration

Tools & Technologies

AI InfrastructureDistributed SystemsDatacenter Design

Industry Keywords

GPU UtilizationFleet EfficiencyInfrastructure PlanningDemand ForecastingProduction Workloads

Tech Stack

Tools & technologies

Distributed SystemsPythonSQL

About the role

Key responsibilities & impact

Build statistical and machine learning models to profile and improve GPU utilization, latency, throughput, and overall fleet efficiency
Develop forecasting models for inference demand across products, regions, and model families
Analyze production workloads to identify latency bottlenecks and capacity constraints, highlighting optimization opportunities
Partner with Capacity Systems Engineering to inform infrastructure planning and long-term GPU investment strategies
Design experiments and simulations to evaluate scheduling policies, serving strategies, and infrastructure tradeoffs
Build dashboards and operational metrics that enable leadership to make data-driven capacity decisions
Collaborate with Product, Research, Finance, and Infrastructure teams to align compute planning with business growth and model roadmaps
Communicate technical findings clearly to engineering teams and executive leadership

Requirements

What you’ll need

MS or PhD in Statistics, Computer Science, Operations Research, Applied Mathematics, Economics, or related quantitative discipline, or equivalent industry experience
5+ years of experience working in the infrastructure data science space
Strong expertise in Python and SQL
Experience building forecasting, optimization, or predictive models
Strong understanding of experimentation, statistical inference, and causal analysis
Experience communicating analytical insights to executive stakeholders
Capacity planning
Distributed systems
AI infrastructure
Datacenter design and buildout
Queueing theory
Time-series forecasting
Operations research
Supply-demand modeling
Reinforcement learning for resource allocation
Cost optimization

Benefits

Comp & perks

Equity
Performance-related bonus(es) for eligible employees
Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
401(k) retirement plan with employer match
Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents)
Paid medical and caregiver leave (up to 8 weeks)
Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
13+ paid company holidays
Multiple paid coordinated company office closures throughout the year for focus and recharge
Paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
Mental health and wellness support
Employer-paid basic life and disability coverage
Annual learning and development stipend
Daily meals in offices, and meal delivery credits as eligible
Relocation support for eligible employees
Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided