Principal Software Engineer

Mirantis

. Own the architecture for Enterprise AI across the AI gateway, control plane, model serving, identity, metering, and observability .

Posted 10/30/2026full-timeRemote • Texas • United StatesLeadWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in Enterprise AI architecture, Kubernetes management, and multi-service system deployment, with a strong focus on mentoring and leading technical teams in a remote-first environment.

Highest-signal resume keywords

Expert KubernetesExpert GoProduction Experience With GPU WorkloadsMulti-Service Systems DeploymentAI-Assisted Development Tools

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Infrastructure ManagementDistributed SystemsPythonCI/CDInfrastructure As CodeLLM InferencePolicy-Based RoutingHelmQuantizationBatching

Soft Skills

MentoringAutonomyCollaboration

Tools & Technologies

KubernetesAI GatewayControl PlaneModel ServingObservability

Industry Keywords

Enterprise AIAI-Assisted DevelopmentSupply-Chain SecurityDesign ReviewsAudit Records

Tech Stack

Tools & technologies

Distributed SystemsKubernetesPythonGo

About the role

Key responsibilities & impact

Own the architecture for Enterprise AI across the AI gateway, control plane, model serving, identity, metering, and observability
Set the technical bar for a small, senior, remote-first team
Lead gateway strategy, including data plane selection and policy-based routing with per-request metering and audit records
Set direction for LLM serving on Kubernetes, including GPU scheduling and sharing, autoscaling, multi-tenancy, disaggregated serving, and cost per token
Define enterprise deployment practices, including Helm installs and upgrades, air-gapped networks, preflight checks, and supply-chain security
Run design reviews, make build-versus-buy decisions, and record decisions as ADRs
Build hands-on in critical-path areas
Mentor senior engineers, including on AI-assisted development
Work with design partners and customers
Represent Mirantis in Kubernetes and ML-infrastructure communities

Requirements

What you’ll need

10+ years in infrastructure or distributed systems, including several as technical lead
Experience shipping multi-service systems that enterprises run in production, including software customers install themselves
Expert Kubernetes: operators, CRDs, scheduling, Helm, and debugging at scale
Production experience with GPU workloads, LLM inference or AI gateways
Expert Go
Strong Python
Solid CI/CD and infrastructure as code
Fluent use of AI-assisted development tools
Ability to thrive with autonomy on a distributed team
Nice to have: inference performance work including quantization, batching, KV-cache management, and disaggregated prefill and decode
Nice to have: AI gateway or LLM routing experience including failover, rate limiting, token metering, and policy enforcement
Nice to have: experience taking a new product to its first enterprise customers

Benefits

Comp & perks

Competitive compensation package
Strong benefits plan
Remote work arrangement