Software Engineer jobs in United States

Explore 1,317 matching jobs.

Spectro Cloud

Senior Software Engineer

Spectro Cloud

Posted: 10/21/2026
AWSAzureCloudDistributed SystemsGoogle Cloud PlatformKubernetesLinuxPythonPyTorch+1 more
General Dynamics Information Technology

Dashboard Developer, Medicare/Medicaid

General Dynamics Information Technology

Posted: 10/21/2026
JavaScriptPythonSQLTableau
EBG

Email Developer

EBG

Posted: 10/21/2026
ETLPythonRustSubversionTypeScript
EBG

Email Developer

EBG

Posted: 10/21/2026
ETLPythonRustSubversionTypeScript
Ottimate

Software Engineer

Ottimate

Posted: 10/21/2026
AngularAWSDjangoDockerERPPostgresPythonTypeScript
BridgeBio

Principal Clinical Database Systems Programmer

BridgeBio

Posted: 10/21/2026
PythonSQLTableauVault
Atria Institute

Director of Engineering, Product

Atria Institute

Posted: 10/21/2026
CTI Staffing

Software Engineer

CTI Staffing

Posted: 10/21/2026
iOSSwift
Skillable

Software Engineer

Skillable

Posted: 10/21/2026
CloudEntity FrameworkJavaScriptNext.jsTypeScript.NET
Lennar

AI Agent Developer

Lennar

Posted: 10/20/2026
AWSCloudJavaScriptPythonSQLTypeScript
Jones Lang LaSalle Americas, Inc.

Union Mobile Engineer

Jones Lang LaSalle Americas, Inc.

Posted: 10/20/2026
Brooks Automation

Software Engineer

Brooks Automation

Posted: 10/20/2026
JavaScriptLinuxPythonSDLCC++
Canvas

Engineering, Summer Intern

Canvas

Posted: 10/20/2026
Salesforce

Software Engineer

Salesforce

Posted: 10/20/2026
Distributed SystemsJavaLinuxPythonSplunkSQLC++
CrowdStrike

Senior AI Agent Developer

CrowdStrike

Posted: 10/20/2026
AWSCloudPython
Trilon Group

CAD Plug In Developer

Trilon Group

Posted: 10/20/2026
GraphQLPostGISPostgresC++.NET
IFS

Director, Global Value Engineering

IFS

Posted: 10/20/2026
State of Florida

Application Systems Programmer I

State of Florida

Posted: 10/20/2026
ITSMServiceNow
Booz Allen Hamilton

Power Apps Developer, Mid

Booz Allen Hamilton

Posted: 10/20/2026
CloudSQLTableau
Mission Technologies, a division of HII

Engineering Intern

Mission Technologies, a division of HII

Posted: 10/20/2026
Assembly
Mission Technologies, a division of HII

Engineering Intern

Mission Technologies, a division of HII

Posted: 10/20/2026
Assembly
Spectro Cloud

Senior Software Engineer

Spectro Cloud
Posted 10/21/2026full-timeSan Jose • California • United StatesSeniorWebsite
Apply

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and operating AI inference services, with a strong focus on performance optimization, reliability, and deployment automation. Proficient in leveraging modern GPU platforms and distributed systems to enhance AI model efficiency and scalability.

Highest-signal resume keywords
AI Inference ServicesPerformance OptimizationKubernetes AutomationPython ProgrammingMulti-GPU Workloads

Tech Stack

Tools & technologies
AWSAzureCloudDistributed SystemsGoogle Cloud PlatformKubernetesLinuxPythonPyTorchGo

About the role

Key responsibilities & impact
  • Build and operate AI inference services in production using engines such as vLLM, SGLang, or TensorRT-LLM
  • Bring new models into service from first test to full rollout
  • Improve throughput, response time, and memory use across the stack
  • Diagnose and fix performance and reliability issues
  • Design benchmarks and release criteria for every model shipped
  • Set reliability targets and meet them in production
  • Scale inference across many GPUs and nodes
  • Run inference on modern GPU platforms and latest accelerators
  • Automate deployment and operations on Kubernetes
  • Write runbooks, tuning guides, and technical documentation
  • Collaborate across teams and communicate technical plans clearly

Requirements

What you’ll need
  • Hands-on experience running AI or LLM inference in production with an engine such as vLLM or TensorRT-LLM
  • Working understanding of inference engines, including batching, caching, and memory management
  • Experience improving performance, reliability, and efficiency of production systems
  • Experience with distributed systems and multi-GPU workloads
  • Experience designing benchmarks and release criteria
  • Bachelor's degree in Computer Science or a related field
  • 4+ years of software development experience, or 2+ years with a Master's degree
  • Strong Python and hands-on PyTorch
  • Golang for backend services and APIs
  • Working knowledge of Kubernetes
  • Experience with modern GPU platforms, drivers, and monitoring tools
  • Understanding of high-speed networking and interconnects
  • Experience with cloud-native applications on AWS, Azure, or GCP
  • Comfort in Linux environments and common command line tools
  • Experience with automated testing
  • Familiarity with AI-assisted development tools
  • Clear written communication in English

Benefits

Comp & perks
  • Efficient and focused hiring interactions
  • Opportunity to grow skills and push boundaries
  • Collaborative, innovative work culture
  • Work with a diverse global team
  • Hybrid work arrangement

ATS Keywords

✓ Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
AI InferenceVLLMTensorRT-LLMPerformance ImprovementBenchmark DesignPythonPyTorchGolangKubernetesCloud-Native Applications
Soft Skills
Clear Communication
Tools & Technologies
Modern GPU PlatformsAWSAzureGCPLinux
Certifications & Qualifications
Bachelor's Degree in Computer Science
Industry Keywords
Distributed SystemsMemory ManagementHigh-Speed NetworkingAutomated TestingAI-Assisted Development Tools