Member of Technical Staff – Software Engineer, GPU Cluster Infrastructure

Perplexity

. Build and own a self-serve compute platform for launching training jobs and operating inference services .

Posted 10/28/2026full-timeUnited StatesLead💰 $250,000 - $485,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and managing self-serve compute platforms, with a focus on GPU provisioning, Kubernetes operations, and distributed systems. Proficient in infrastructure programming and capable of ensuring workload resilience and high availability for training and inference services.

Highest-signal resume keywords

Deep Kubernetes ExperienceGPU Cluster ManagementInfrastructure Programming in Go, Rust, or C++Distributed Systems FundamentalsObservability with Prometheus or Grafana

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Kubernetes OperatorsGPU ProvisioningCUDAInfiniBandResource AllocationScheduling LogicFault ToleranceMulti-Cloud OrchestrationHPC SchedulersObservability

Tools & Technologies

CoreWeaveAWSGCPVLLMSGLangTensorRT-LLMSlurmTritonPrometheusGrafana

Industry Keywords

Distributed Training JobsInference ServicesGPU Fleet ManagementCluster ConfigurationCapacity IntegrationWorkload ResilienceMulti-Provider ClustersHigh-Availability ServicesReal-Time AI InferenceCloud Infrastructure

Tech Stack

Tools & technologies

AWSCloudDistributed SystemsGoogle Cloud PlatformGrafanaKubernetesPrometheusRustC++Go

About the role

Key responsibilities & impact

Build and own a self-serve compute platform for launching training jobs and operating inference services
Abstract GPU provisioning, cluster configuration, and provider-specific infrastructure
Own GPU fleet provisioning, lifecycle management, reliability, and capacity integration across providers
Build scheduling and placement logic to locate and efficiently pack available GPU capacity
Support long-running distributed training jobs and production inference services on the same fleet
Write Kubernetes operators and CRDs and manage multi-provider clusters
Build fault tolerance, autoscaling, and observability for workload resilience and fleet utilization
Partner with inference and cloud infrastructure engineers on platform architecture and roadmap
Operate infrastructure supporting Perplexity, which serves hundreds of millions of queries per month and real-time AI inference requests

Requirements

What you’ll need

Deep Kubernetes experience, including custom operators, CRDs, and multi-cluster federation
Experience managing GPU clusters at scale
Experience with NVIDIA hardware and CUDA
Experience with InfiniBand or RoCE networking
Experience orchestrating compute across multiple clouds, such as CoreWeave, AWS, or GCP
Strong distributed systems fundamentals, including scheduling, resource allocation, and fault tolerance under load
Infrastructure and systems-level programming in Go, Rust, or C++
Experience supporting long-running training jobs and high-availability inference services
Experience with vLLM, SGLang, or TensorRT-LLM valued
Experience with Slurm or other HPC schedulers valued
GPU kernel work in CUDA or Triton valued
Production experience with InfiniBand, RoCE, or RDMA valued
Observability experience with Prometheus, Grafana, or Weights & Biases valued
Ability to come into the office four days per week
Work authorization or sponsorship question pertains to employment visa status in the United States

Benefits

Comp & perks

Equity
Health insurance
Dental insurance
Vision insurance
Retirement benefits
Fitness benefits
Commuter benefits
Dependent care accounts
Regionally tailored benefits for international employees