Software Engineer

Cisco

. Develop and operate the Foundational Model Service platform serving AI models to Cisco IT .

Posted 9/29/2026full-timeUnited StatesJunior💰 $128,600 - $184,900 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing and operating AI model-serving platforms, with a strong focus on Kubernetes, secure coding practices, and automated validation processes. Proficient in collaborating with cross-functional teams to create technical documentation and support critical services.

Highest-signal resume keywords

KubernetesNVIDIA NIMVLLMSecure Coding PracticesModel Evaluation

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI Model DevelopmentProduction Service OperationAutomated RemediationDebuggingBenchmarking

Soft Skills

MentoringCollaborationTechnical Documentation

Tools & Technologies

LinuxNVIDIA CUDAAMD ROCmTritonKubernetes Clusters

Industry Keywords

AI InfrastructureModel OnboardingDistributed InferenceCapacity PlanningCost Optimization

Tech Stack

Tools & technologies

KubernetesLinux

About the role

Key responsibilities & impact

Develop and operate the Foundational Model Service platform serving AI models to Cisco IT
Support model onboarding and releases
Participate in the shared on-call rotation
Automate validation that gates deployments
Contribute to monitoring platform and service behavior
Apply agentic solutions to operations for earlier problem detection and automated remediation
Develop software using Cisco Design Thinking Principles and secure coding practices
Partner with design, product management, and engineering teams
Create technical design documentation and end-user documentation
Debug platform issues in development and production
Benchmark, evaluate, monitor, and release new models as needed
Help build and operate model-serving infrastructure on Kubernetes clusters using Nim, vLLM, and other runtimes

Requirements

What you’ll need

Bachelor’s degree in Computer Science, Information Systems, or a related field with 3 years of related experience; master’s degree with 1 year of related experience; PhD; or equivalent practical work experience
Experience developing and operating production services on Kubernetes and Linux
Exposure to GPU-based AI infrastructure
Hands-on experience serving models with vLLM, NVIDIA NIM, Triton, or a comparable inference runtime
Experience building supporting services
Experience leading technical work, mentoring engineers, documenting systems, and supporting critical services through an on-call rotation
Preferred: experience evaluating and benchmarking models for production release decisions
Preferred: experience operating GPU workloads with NVIDIA CUDA or AMD ROCm
Preferred: familiarity with distributed inference, disaggregated serving, KV-cache-aware routing, capacity planning, or cost optimization
Preferred: experience fine-tuning transformer models or evaluating RAG and agent systems using relevant frameworks

Benefits

Comp & perks

Medical, dental and vision insurance
401(k) plan with a Cisco matching contribution
Paid parental leave
Short- and long-term disability coverage
Basic life insurance
Cisco restricted stock unit grants may be available, vesting following continued employment
10 paid holidays per full calendar year
1 floating holiday for non-exempt employees
Paid birthday day off
Paid year-end holiday shutdown
4 paid days off for personal wellness
16 days of paid vacation per full calendar year for non-exempt employees
Flexible vacation time off program with no defined limit for eligible exempt employees
80 hours of sick time off provided on hire date and each January 1st thereafter
Up to 80 hours of unused sick time carried forward
Additional paid time away for critical or emergency family issues
Optional 10 paid volunteer days per full calendar year
Annual bonuses for non-sales roles, subject to Cisco policies