Senior Software Engineer, Inference

AssemblyAI

. Design and ship customer-facing APIs exposing new model capabilities, from prototype through launch and ongoing iteration .

Posted 11/2/2026full-timeRemote • United StatesSenior💰 $190,000 - $225,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in backend engineering and machine learning infrastructure, with a focus on designing and deploying customer-facing APIs. Strong collaboration with researchers and applied teams to enhance product design and ensure reliable system performance.

Highest-signal resume keywords

Backend EngineeringMachine Learning InfrastructureCustomer-Facing APIsCollaboration SkillsAI/ML Curiosity

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

API DesignInfrastructure ScalingProduction SystemsModel Behavior UnderstandingLow-Latency Systems

Soft Skills

Comfort Operating with AmbiguityGenuine Curiosity

Tools & Technologies

Inference InfrastructureSDK DevelopmentInternal Tooling

About the role

Key responsibilities & impact

Design and ship customer-facing APIs exposing new model capabilities, from prototype through launch and ongoing iteration
Scale inference infrastructure to support 1M+ API users
Partner with researchers to productionize new techniques, converting notebooks or proofs of concept into reliable, low-latency, customer-ready systems
Work with customers and Applied teams to understand product usage and inform product design and research direction
Contribute across backend services, inference infrastructure, SDKs, and internal tooling

Requirements

What you’ll need

Strong backend engineering experience, including building and supporting machine learning infrastructure and/or customer-facing APIs in production
Comfort operating with ambiguity
Genuine curiosity about AI/ML
Ability to understand model behavior sufficiently to make sound engineering decisions
Strong collaboration skills with researchers, applied engineers, and customers

Benefits

Comp & perks

Compensation, benefit, and other reward opportunities
Candidate AI Guidance explaining permitted AI use during the interview process