Distinguished Engineer – Rack Scale Architecture

NVIDIA

. Drive the software end-to-end architecture for NVIDIA's rack-scale products .

Posted 10/27/2026full-timeRemote • California • United StatesSeniorLead💰 $320,000 - $488,750 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive expertise in system architecture and design, particularly for scalable server systems, with a strong focus on networking technologies and protocols. Proven ability to mentor teams, drive product roadmaps, and make critical technical decisions in complex environments.

Highest-signal resume keywords

System Architecture And DesignNetworking Technologies And ProtocolsExperience With GPUs, DPUs, And FPGAsLarge-Scale Cloud DeploymentMentoring Engineering Teams

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

System ArchitectureSoftware RequirementsScalable Server SystemsNetworking ProtocolsComplex System SoftwareOut-Of-Band ManagementIn-Band ManagementSystem Management ProtocolsRobust Fabric DesignCXL And UCIE Architectures

Soft Skills

Excellent Communication SkillsMentoring

Tools & Technologies

RedfishIPMICloud Management Systems

Industry Keywords

Data Center ProductsHyperscalersCloud Service ProvidersProgram ExecutionProduct Roadmap

Tech Stack

Tools & technologies

Cloud

About the role

Key responsibilities & impact

Drive the software end-to-end architecture for NVIDIA's rack-scale products
Translate forward-looking product plans into clear, formal software requirements
Serve as a trusted architectural partner to teams requiring guidance or oversight
Work directly with major customers to understand requirements and align their roadmaps with NVIDIA's roadmap
Work with business partners and vendors to shape products to meet NVIDIA's needs
Develop a roadmap of new technologies and protocols and drive their design and adoption
Mentor architects and engineering teams
Make key technical decisions in ambiguous situations
Maintain deep understanding of NVIDIA's product portfolio and roadmap
Engage with hyperscalers and cloud service providers to take products to market

Requirements

What you’ll need

BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience
15+ years in system architecture and design
Deep experience designing architecture for scalable and performant server systems, particularly at the software/hardware interface
Strong understanding of networking technologies and protocols, such as Ethernet and InfiniBand
Experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAs
Expertise in out-of-band and in-band management architectures
Knowledge of system management protocols such as Redfish and IPMI
Experience working with platform security experts to define tradeoffs between security and ease of use
Demonstrable experience implementing left shift strategy to de-risk program execution
Excellent written and verbal communication skills
Knowledge of large-scale cloud and cluster-level deployment and management systems
Experience designing robust, resilient, and performant scale-up fabrics
Track record of leading data center products across inception, pre-silicon development, post-silicon bring-up, manufacturing, and deployment
Familiarity with CXL, UCIE, and other C2C technology architectures
Knowledge of storage and networking technologies

Benefits

Comp & perks

Equity
Benefits
Inclusive work environment
Equal opportunity employment