Senior Software Engineer

Mirantis

. Design and build LLM serving infrastructure on Kubernetes, including deployment, GPU scheduling, scaling, and model lifecycle management .

Posted 11/11/2026full-timeRemote • North Carolina • United StatesSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and building LLM serving infrastructure on Kubernetes, with strong capabilities in GPU scheduling, model lifecycle management, and enterprise deployment. Proficient in Go programming and CI/CD practices, with a focus on integrating AI-assisted development tools into the engineering workflow.

Highest-signal resume keywords

Kubernetes Infrastructure ManagementGo ProgrammingCI/CD PracticesGPU Workloads ExperienceHelm Chart Development

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringInfrastructure ManagementDistributed SystemsModel Lifecycle ManagementGPU SchedulingObservability MetricsAPI IntegrationAI-Assisted Development ToolsInfrastructure-As-CodeEnterprise Deployment

Soft Skills

High AutonomyRemote CollaborationWritten Communication

Tools & Technologies

KubernetesHelmClaude CodeOpenAI Codex

Industry Keywords

LLM InferenceProduction WorkloadsMulti-Service CodebaseEngineering DirectionOpen-Source Contributions

Tech Stack

Tools & technologies

Distributed SystemsKubernetesGo

About the role

Key responsibilities & impact

Design and build LLM serving infrastructure on Kubernetes, including deployment, GPU scheduling, scaling, and model lifecycle management
Package the platform for enterprise environments using Helm-based installs and upgrades, including restricted/offline networks
Integrate the serving layer with the platform’s API gateway, identity, and metering services
Build observability for operating GPU inference in production, including serving metrics and GPU telemetry
Contribute across a multi-service codebase
Help set engineering direction through design documents and reviews

Requirements

What you’ll need

5+ years of software engineering experience in infrastructure, platform, or distributed systems
Deep hands-on Kubernetes experience building and operating production workloads and Helm charts
Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast
Strong Go programming skills
Solid CI/CD and infrastructure-as-code skills
Fluency with AI-assisted development tools, including Claude Code and OpenAI Codex, as part of daily engineering workflow
Comfortable with high autonomy on a small, remote-first, written-culture team
Inference performance work, enterprise deployment experience, UI development experience, and open-source contributions are nice to have

Benefits

Comp & perks

Competitive compensation package
Strong benefits plan
Open-source innovation opportunities
Collaboration with talented colleagues
Continuous growth environment