Software Engineer jobs in United States
Explore 1,317 matching jobs.
Senior Software Engineer
Spectro Cloud
Posted: 10/21/2026Dashboard Developer, Medicare/Medicaid
General Dynamics Information Technology
Posted: 10/21/2026Email Developer
EBG
Posted: 10/21/2026Email Developer
EBG
Posted: 10/21/2026Software Engineer
Ottimate
Posted: 10/21/2026Principal Clinical Database Systems Programmer
BridgeBio
Posted: 10/21/2026Director of Engineering, Product
Atria Institute
Posted: 10/21/2026Software Engineer
CTI Staffing
Posted: 10/21/2026Software Engineer
Skillable
Posted: 10/21/2026AI Agent Developer
Lennar
Posted: 10/20/2026Union Mobile Engineer
Jones Lang LaSalle Americas, Inc.
Posted: 10/20/2026Software Engineer
Brooks Automation
Posted: 10/20/2026Engineering, Summer Intern
Canvas
Posted: 10/20/2026Software Engineer
Salesforce
Posted: 10/20/2026Senior AI Agent Developer
CrowdStrike
Posted: 10/20/2026CAD Plug In Developer
Trilon Group
Posted: 10/20/2026Director, Global Value Engineering
IFS
Posted: 10/20/2026Application Systems Programmer I
State of Florida
Posted: 10/20/2026Power Apps Developer, Mid
Booz Allen Hamilton
Posted: 10/20/2026Engineering Intern
Mission Technologies, a division of HII
Posted: 10/20/2026Engineering Intern
Mission Technologies, a division of HII
Posted: 10/20/2026
Senior Software Engineer
Spectro CloudCore Competencies
Role fitUse this summary to align your resume positioning with the role.
Demonstrates expertise in building and operating AI inference services, with a strong focus on performance optimization, reliability, and deployment automation. Proficient in leveraging modern GPU platforms and distributed systems to enhance AI model efficiency and scalability.
Tech Stack
Tools & technologiesAbout the role
Key responsibilities & impact- Build and operate AI inference services in production using engines such as vLLM, SGLang, or TensorRT-LLM
- Bring new models into service from first test to full rollout
- Improve throughput, response time, and memory use across the stack
- Diagnose and fix performance and reliability issues
- Design benchmarks and release criteria for every model shipped
- Set reliability targets and meet them in production
- Scale inference across many GPUs and nodes
- Run inference on modern GPU platforms and latest accelerators
- Automate deployment and operations on Kubernetes
- Write runbooks, tuning guides, and technical documentation
- Collaborate across teams and communicate technical plans clearly
Requirements
What you’ll need- Hands-on experience running AI or LLM inference in production with an engine such as vLLM or TensorRT-LLM
- Working understanding of inference engines, including batching, caching, and memory management
- Experience improving performance, reliability, and efficiency of production systems
- Experience with distributed systems and multi-GPU workloads
- Experience designing benchmarks and release criteria
- Bachelor's degree in Computer Science or a related field
- 4+ years of software development experience, or 2+ years with a Master's degree
- Strong Python and hands-on PyTorch
- Golang for backend services and APIs
- Working knowledge of Kubernetes
- Experience with modern GPU platforms, drivers, and monitoring tools
- Understanding of high-speed networking and interconnects
- Experience with cloud-native applications on AWS, Azure, or GCP
- Comfort in Linux environments and common command line tools
- Experience with automated testing
- Familiarity with AI-assisted development tools
- Clear written communication in English
Benefits
Comp & perks- Efficient and focused hiring interactions
- Opportunity to grow skills and push boundaries
- Collaborative, innovative work culture
- Work with a diverse global team
- Hybrid work arrangement
ATS Keywords
✓ Tailor your resumeTip: use these terms in your resume and cover letter to boost ATS matches.