Production Engineer

• Build and operate production software, automation, and tooling for control plane services, model deployments, and inference and agentic workloads across DGX Cloud environments
• Improve the reliability of inference and agentic platforms and services, including NVIDIA Cloud Functions, SGLang- and vLLM-based endpoints, and inference services built with NVIDIA Dynamo
• Improve endpoint availability, inference routing, capacity management, and service health
• Use infrastructure as code and GitOps to deploy, configure, validate, upgrade, and recover services consistently across environments
• Build workflows for service enablement, model releases, handoff, deprecation, and ongoing operations
• Define and instrument SLIs and SLOs for inference and control plane services and use error budgets to guide reliability improvements
• Participate in on-call and incident response, troubleshoot failures, and turn recurring issues into automation and durable fixes
• Collaborate with model, platform, storage, networking, security, and GPU infrastructure teams to design and operate services safely at scale

Senior Production Engineer – DGX Cloud

• Build automation for bare-metal provisioning, hardware validation, firmware and software upgrades, repair, and cluster lifecycle management
• Develop tools that interact with BMC and Redfish interfaces to monitor hardware health, manage server state, and assist recovery workflows
• Handle and advance NVIDIA NVL72 systems and BlueField-3 or later DPUs throughout cloud partner and on-premises environments
• Diagnose failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes; turn recurring issues into automated detection and repair
• Define validation and handoff criteria so new capacity enters production safely and consistently
• Take part in on-call duties, incident response, root-cause analysis, and follow-up to implement permanent solutions
• Work with hardware, networking, platform, data center operations, and partner teams to resolve issues across ownership boundaries

Senior Software Engineer, SRE, Production Engineering

• Build and operate critical infrastructure across compute, storage, messaging, and observability systems
• Drive architectural change by proposing solutions for reliability and scalability issues and leading them through resolution
• Partner with product teams during design reviews and embed golden paths
• Contribute hands-on to Ramp’s move to a cellular architecture
• Support AI-powered products by developing infrastructure patterns and reusable golden paths
• Build developer tooling and self-service infrastructure for cost, performance, and reliability visibility
• Participate in the on-call rotation and eliminate incident root causes
• Initiate cross-team architectural reviews
• Lead company-wide reliability and scalability initiatives from problem identification through completion
• Write production code and own infrastructure systems end-to-end

Tech Lead, Production Engineering

• Build and maintain production forecasts across the portfolio to support long-term planning, capital allocation, and corporate strategy
• Develop and update type curves and decline/analytical models calibrated to observed field performance
• Translate reservoir performance and subsurface uncertainty into probabilistic forecast ranges (P10/P50/P90) for planning and budgeting cycles
• Maintain the long-range plan (LRP) production forecast in coordination with Development and Corporate Finance
• Partner with Corporate Finance to translate reservoir forecasts into cash flow models, capital plans, and investor-facing materials
• Support financing processes, including debt/equity raises and project finance, with technical forecast inputs and asset-level due diligence
• Conduct economic evaluations of new prospects, development scenarios, and capital projects, including NPV, IRR, payback, and sensitivity analysis
• Support investment decisions with integrated technical and economic risk assessment across the portfolio
• Evaluate development, completion, and injection strategy alternatives for capital efficiency and returns
• Deliver clear economic recommendations to asset teams and leadership to guide portfolio prioritization
• Own and maintain recoverable resource and Heat-in-Place (HIIP) estimates
• Promote consistent forecasting, evaluation, and reserves methodologies across projects
• Support development and standardization of geothermal recovery and resource evaluation methods
• Collaborate with Finance, Development, Reservoir, asset, and Executive teams
• Contribute to transparency, consistency, and continuous improvement across the portfolio
• Operate independently and reliably in remote settings while adapting to shifting priorities, new data, and evolving planning cycles

Reservoir Engineer, Production Forecasting – Reserves

• Build and operate automation for large-scale GPU clusters across NVIDIA Cloud Partners and on-prem environments
• Develop tools and services for provisioning, validation, upgrades, monitoring, repair, and cluster lifecycle operations
• Improve Day 0 / Day 1 / Day 2 workflows for cluster bringup, handoff, and production operations
• Reduce manual production touches through APIs, GitOps, automation, and agent-assisted workflows
• Participate in on-call, incident response, debugging, and durable follow-up work
• Partner with platform, storage, networking, security, and workload teams to make infrastructure production-ready

Senior Software Engineer, DGX Cloud Production Engineering

• Design and support in-house video, audio, and control systems
• Support the maintenance department with problem-solving and repair of broadcast systems
• Maintain network and system documentation
• Conform to CBS security policies, initiatives, and compliance reporting
• Supervise projects as they relate to wiring technicians
• Craft and support the systems needed to put together shows at the historic broadcast center

Principal Engineer, Production Systems

• Detect, isolate, document, report, and resolve system outages or operational problems
• Collect diagnostic data, restore system operation, and develop workarounds as needed
• Document problems in logging and discrepancy reporting tools
• Work directly with the customer on day-to-day activities
• Respond to user calls regarding hardware and software problems
• Correct problems or escalate them when required
• Communicate problem status to users and senior management
• Perform maintenance and installation of computing infrastructure
• Implement continuous improvement through IT systems or procedures
• Maintain inventory of system assets
• Ensure compliance with VA standards and security policies
• Provide documentation and training
• Perform additional duties as assigned

Senior Systems Engineer – Production Support

• Detect, isolate, document, rapidly report, and resolve system outages or operational problems
• Collect diagnostic data, restore system operation, develop workarounds, and perform recovery activities
• Document problems in logging and discrepancy reporting tools
• Work directly with the customer on day-to-day activities
• Respond to user calls about hardware and software problems, correcting or escalating issues as needed
• Communicate problem status to users and senior management
• Perform maintenance and installation of computing infrastructure
• Implement continuous improvement through IT systems or procedures
• Maintain inventory of system assets
• Ensure compliance with VA standards and security policies
• Provide documentation and training
• Perform additional duties as assigned

• Provide technical leadership within the team for AI security, product security, secure design, and security engineering work
• Plan, estimate, prioritize, and deliver engineering work while managing concurrent priorities
• Design, build, test, deploy, and troubleshoot production-ready security services, integrations, automation, and developer tooling
• Perform threat modeling and security architecture reviews for AI-enabled applications, services, APIs, data flows, agentic workflows, and supporting platforms
• Review code and designs for authentication, authorization, RBAC, input validation, data protection, logging, error handling, database access, and other security concerns
• Translate business needs, customer feedback, and security requirements into technical requirements, implementation plans, and measurable outcomes
• Recommend priorities and design or configuration decisions using data and risk context
• Work across engineering, product, platform, risk, and cybersecurity teams to resolve issues and drive actions to completion
• Identify process, tooling, and control gaps and implement improvements
• Contribute to design, code, security, observability, performance, and operational-readiness reviews
• Document technical decisions, operating procedures, support guidance, and lessons learned
• Help teammates through reviews, pairing, technical discussions, and documentation
• Assess risks associated with AI models, agents, prompts, RAG, MCP, tools, data sources, memory, and downstream actions
• Apply secure-by-design practices to AI-enabled systems
• Build or integrate automated safeguards, evaluation workflows, security tests, and monitoring
• Partner with developers to provide remediation guidance and validate security fixes

Production Engineer jobs in United States

Senior Production Engineer – DGX Cloud

Senior Software Engineer, SRE, Production Engineering

Tech Lead, Production Engineering

Reservoir Engineer, Production Forecasting – Reserves

Senior Software Engineer, DGX Cloud Production Engineering

Principal Engineer, Production Systems

Senior Systems Engineer – Production Support

Senior Systems Engineer – Production Support

Senior Engineer – Production Security