Senior AI Infrastructure Engineer – DGX Cloud

NVIDIA

. Design, build, deploy, and run internal tooling for large-scale AI training and inferencing platforms on cloud infrastructure .

Posted 11/10/2026full-timeRemote • United StatesSenior💰 $152,000 - $287,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing, building, and deploying internal tooling for large-scale AI training and inferencing platforms on cloud infrastructure, with a strong focus on automation, system reliability, and performance analysis. Proficient in managing the full service lifecycle and supporting production systems through effective incident response and stakeholder engagement.

Highest-signal resume keywords

Cloud Infrastructure ManagementDistributed Systems ArchitectureInfrastructure AutomationPython ProgrammingKubernetes Experience

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonGoC/C++JavaLinuxNetworkingStorage TechnologiesContainers TechnologiesInfrastructure as Code (IAAC)Terraform

Soft Skills

Strong Communication SkillsSystematic Problem-SolvingOwnershipCollaborationStakeholder Engagement

Tools & Technologies

KubernetesSlurmMulti-GPU ClustersAutomation ToolsMonitoring Tools

Industry Keywords

AI TrainingPerformance CharacterizationService Lifecycle ManagementIncident ResponseCloud Systems

Tech Stack

Tools & technologies

CloudDistributed SystemsJavaKubernetesLinuxNode.jsPythonTerraformC++Go

About the role

Key responsibilities & impact

Design, build, deploy, and run internal tooling for large-scale AI training and inferencing platforms on cloud infrastructure
Conduct performance characterization and analysis on large multi-GPU and multi-node clusters
Improve the full service lifecycle from inception and design through deployment, operation, and refinement
Support services before launch through system design consulting, software tools, platforms, frameworks, capacity management, and launch reviews
Measure and monitor availability, latency, and overall system health of live services
Scale systems sustainably through automation and improve reliability and velocity
Practice sustainable incident response and blameless postmortems
Participate in an on-call rotation supporting production systems

Requirements

What you’ll need

BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience
5+ years of experience
Track record balancing project initiation, collaboration, and stakeholder engagement
Background in infrastructure automation and distributed systems architecture for large-scale private or public cloud platforms in production
Experience with Python, Go, C/C++, or Java
Comprehensive understanding of Linux, Networking, Storage, and Containers Technologies
Experience with Public Cloud and Infrastructure as Code (IAAC) and Terraform
Distributed system experience
Interest in crafting, analyzing, and fixing large-scale distributed systems
Systematic problem-solving approach, strong communication skills, ownership, and drive
Capability to identify issues, improve code performance, and automate routine tasks
Experience operating or handling large private and public cloud systems based on Kubernetes or Slurm

Benefits

Comp & perks

Equity
Benefits
Support and mentorship to foster learning and growth