Software Engineer jobs in United States

Explore 1,345 matching jobs.

Spectro Cloud

Senior Software Engineer

Spectro Cloud

Posted: 10/21/2026
AWSAzureCloudDistributed SystemsGoogle Cloud PlatformKubernetesLinuxPythonPyTorch+1 more
SEON

Senior WordPress Developer

SEON

Posted: 10/21/2026
DNSJavaScriptMySQLPHPReactSCSSWordPress
Humana

Software Engineer

Humana

Posted: 10/21/2026
Cyber SecurityJavaScript
GlobalFoundries

Engineer – Frame Engineering

GlobalFoundries

Posted: 10/21/2026
Unix
Saint Louis University

Web Application Developer

Saint Louis University

Posted: 10/21/2026
CloudJavaScriptjQueryMySQLPHP
Miratech

Software Engineer

Miratech

Posted: 10/21/2026
AzureCloudDistributed SystemsGoogle Cloud PlatformKafkaMicroservicesReactGo
Miratech

Software Engineer

Miratech

Posted: 10/21/2026
AzureCloudDistributed SystemsGoogle Cloud PlatformKafkaMicroservicesReactGo
Regal Rexnord

Engineering Intern

Regal Rexnord

Posted: 10/21/2026
RTX

Senior ABAP Developer

RTX

Posted: 10/21/2026
Gametime

Director of Engineering – Fan Experience

Gametime

Posted: 10/21/2026
ReactReact NativeSQL
Gusto

Workday System Developer

Gusto

Posted: 10/21/2026
Kemper

Lead Microsoft Dynamics 365 Developer

Kemper

Posted: 10/21/2026
AzureJavaJavaScriptServiceNowSplunkSpringSpring BootSpringBoot.NET
Vitalant

Senior ERP Developer – Workday

Vitalant

Posted: 10/21/2026
CloudERPSOAP
AMERICAN SYSTEMS

Engineering Technician, 5

AMERICAN SYSTEMS

Posted: 10/21/2026
Linux
ComPsych

Senior Mobile Engineer

ComPsych

Posted: 10/21/2026
JavaJestKotlinPythonReactReact NativeSwiftGo
Truist

Lead zOS Systems Programmer

Truist

Posted: 10/21/2026
Cloud
Nimble Gravity

Manager, Forward Deployed Engineering

Nimble Gravity

Posted: 10/21/2026
AWSAzureCloudGoogle Cloud PlatformPythonTypeScript
AHEAD

Engineering Technician

AHEAD

Posted: 10/21/2026
AssemblyLinux
dentsu Austria

Messaging Developer

dentsu Austria

Posted: 10/21/2026
BootstrapCloudJavaScriptOracle
NextEra Energy, Inc.

Project Director – Pipeline Engineering, Construction

NextEra Energy, Inc.

Posted: 10/21/2026
Miratech

Software Engineer

Miratech

Posted: 10/21/2026
AngularAWSAzureCloudDistributed SystemsGoogle Cloud PlatformJavaJavaScriptKafka+4 more
Spectro Cloud

Senior Software Engineer

Spectro Cloud
Posted 10/21/2026full-timeSan Jose • California • United StatesSeniorWebsite
Apply

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and operating AI inference services, with a strong focus on performance optimization, reliability, and deployment automation using modern GPU platforms and Kubernetes. Proficient in Python and PyTorch, with hands-on experience in model optimization and cloud-native applications.

Highest-signal resume keywords
AI Inference ServicesPython ProgrammingKubernetes AutomationPerformance OptimizationMulti-GPU Workloads

Tech Stack

Tools & technologies
AWSAzureCloudDistributed SystemsGoogle Cloud PlatformKubernetesLinuxPythonPyTorchGo

About the role

Key responsibilities & impact
  • Build and operate AI inference services in production using engines such as vLLM, SGLang, or TensorRT-LLM
  • Bring new models into service from first test through full rollout
  • Improve throughput, response time, and memory use across the stack
  • Diagnose and fix performance and reliability issues
  • Design benchmarks and release criteria for every model shipped
  • Set and meet production reliability targets
  • Scale inference across many GPUs and nodes
  • Run inference on modern GPU platforms, including the latest accelerators
  • Automate deployment and operations on Kubernetes
  • Write runbooks, tuning guides, and technical documentation

Requirements

What you’ll need
  • Hands-on experience running AI or LLM inference in production with an engine such as vLLM or TensorRT-LLM
  • Working understanding of inference engines, including batching, caching, and memory management
  • Experience improving performance, reliability, and efficiency of production systems
  • Experience with distributed systems and multi-GPU workloads
  • Experience designing benchmarks and release criteria
  • Bachelor's degree in Computer Science or a related field
  • 4+ years of software development experience, or 2+ years with a Master's degree
  • Strong Python and hands-on PyTorch
  • Golang for backend services and APIs
  • Working knowledge of Kubernetes
  • Experience with modern GPU platforms, drivers, and monitoring tools
  • Understanding of high-speed networking and interconnects
  • Experience with cloud-native applications on AWS, Azure, or GCP
  • Comfort in Linux environments and common command line tools
  • Experience with automated testing
  • Familiarity with AI-assisted development tools
  • Clear written communication in English
  • Experience with model optimization, quantization, and acceleration
  • GPU scheduling in Kubernetes
  • Experience with monitoring and observability tools
  • Kubernetes certification such as CKA or CKAD

Benefits

Comp & perks
  • Efficient and focused hiring process
  • Opportunity to grow skills, push boundaries, and make a big impact
  • Collaborative, innovation-focused culture
  • Work with diverse teams and customers worldwide

ATS Keywords

✓ Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
AI InferenceModel OptimizationPerformance TuningDistributed SystemsBatchingCachingMemory ManagementGolangPyTorchLinux Environments
Soft Skills
Clear Written Communication
Tools & Technologies
KubernetesAWSAzureGCPMonitoring ToolsObservability ToolsGPU PlatformsHigh-Speed Networking
Certifications & Qualifications
CKACKAD
Industry Keywords
Cloud-Native ApplicationsAI-Assisted Development ToolsInference EnginesAutomated Testing