AI Infrastructure Technical Systems Engineer

Cisco

. Serve as principal systems architect and technical authority for enterprise AI platforms .

Posted 10/23/2026full-timeUnited StatesMid-LevelSenior💰 $140,300 - $178,100 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in architecting and managing enterprise AI platforms, with a strong focus on Kubernetes, GPU clusters, and automation tools. Proven ability to lead complex infrastructure initiatives while optimizing performance and ensuring operational excellence.

Highest-signal resume keywords

Enterprise AI Platform ArchitectureKubernetes AdministrationAnsible and Terraform AutomationHigh-Speed Network Fabric DesignGPU Software Stack Optimization

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

PythonGoBashKubernetesRed Hat OpenShiftSlurmKueueVolcanoRayNVIDIA CUDA

Soft Skills

MentoringCollaborationIncident ManagementRoot-Cause Analysis

Tools & Technologies

GitOpsCI/CDOpenTelemetryPrometheusSplunkHashiCorp Vault

Certifications & Qualifications

CKACKSRHCARHCE

Industry Keywords

Enterprise Systems EngineeringHPCSREAI InfrastructureRDMARoCEv2Out-of-Band ManagementTelemetry Frameworks

Tech Stack

Tools & technologies

AnsibleKubernetesLinuxNode.jsOpenShiftPrometheusPythonRaySplunkTerraformVaultGo

About the role

Key responsibilities & impact

Serve as principal systems architect and technical authority for enterprise AI platforms
Establish architectural direction and lead complex infrastructure initiatives
Design, qualify hardware for, plan capacity of, and maintain large-scale bare-metal NVIDIA/AMD GPU clusters
Architect resilient multi-tenant compute and control planes across bare-metal Kubernetes, Red Hat OpenShift, and NVIDIA BCM
Collaborate with network engineering to design, benchmark, and optimize RDMA/RoCEv2 backend fabrics at 400G/800G
Champion SRE practices, autonomous self-healing, operational toil reduction, and stringent SLOs
Architect IaC and GitOps deployment pipelines using Ansible, Terraform, Python, Go, and CI/CD tooling
Oversee automated firmware, BIOS/BMC, kernel driver, platform upgrade, and certificate rotation workflows
Optimize distributed workload scheduling, fair-share queueing, and GPU quota governance across Slurm, Kueue, Volcano, and Ray
Profile low-level systems performance and diagnose interconnect, bandwidth, memory, and compute-efficiency bottlenecks
Establish Day-2 diagnostics and recovery procedures for GPU degradation, driver anomalies, and hardware faults
Architect observability standards using OpenTelemetry, Prometheus, and Splunk
Deliver role-specific visualization dashboards and anomaly detectors
Lead high-impact incident escalations and root-cause analyses aligned with ITIL frameworks
Author architecture blueprints and SOPs
Mentor and coach mid-level and senior engineers
Collaborate with AI researchers, Cisco hardware and network architecture teams, and ecosystem partners including NVIDIA, AMD, and Red Hat

Requirements

What you’ll need

Bachelor’s degree in Computer Science, Engineering, IT, or related discipline
5+ years of progressive experience in enterprise systems engineering, HPC, AI infrastructure, or SRE
Proficiency in Python, Go, or Bash
Extensive experience building declarative automation with Ansible, Terraform, CI/CD, and GitOps
Advanced expertise designing and administering production Kubernetes, Red Hat OpenShift, and HPC workload managers including Slurm, Kueue, Volcano, and Ray
Strong hands-on understanding of AI backend network fabrics, RDMA/RoCEv2, and high-speed multi-hundred-gigabit network topologies
In-depth knowledge of enterprise Linux, kernel module lifecycle, memory subsystems, GPU device drivers, and out-of-band management with Redfish/IPMI
Master’s degree in Computer Science, Computer Engineering, or related technical discipline preferred, or 2+ additional years of equivalent specialized engineering experience
3+ years managing enterprise server platforms at scale, including 500+ node environments, automated hardware provisioning, and centralized infrastructure management
2+ years deploying, troubleshooting, and optimizing heterogeneous GPU software stacks such as NVIDIA CUDA and AMD ROCm in production
3+ years designing and implementing enterprise secrets management architectures such as HashiCorp Vault and integrating OIDC, SAML, and SSO
At least one active, current industry-recognized advanced certification, such as CKA/CKS, RHCA/RHCE, or advanced networking credentials
Demonstrable contributions to open-source infrastructure projects, Kubernetes SIGs, HPC scheduling communities, or telemetry frameworks

Benefits

Comp & perks

Medical, dental and vision insurance
401(k) plan with a Cisco matching contribution
Paid parental leave
Short- and long-term disability coverage
Basic life insurance
Eligibility for Cisco restricted stock unit grants
10 paid holidays per full calendar year
1 floating holiday for non-exempt employees
1 paid birthday day off
Paid year-end holiday shutdown
4 paid personal wellness days
16 days of paid vacation per full calendar year for non-exempt employees
Flexible vacation time off program with no defined limit for eligible exempt employees
80 hours of sick time off provided on hire date and each January 1st thereafter
Up to 80 hours of unused sick time carried forward annually
Additional paid time away for critical or emergency family issues
Optional 10 paid volunteer days per full calendar year
Annual bonuses for non-sales roles, subject to Cisco policies
Performance-based incentive pay for sales-plan employees