Software Engineer, Agentic AI Systems

Rescale

. Build and operate LLM-backed APIs, agents, retrieval systems, and integrations with internal and external systems .

Posted 10/5/2026full-timeRemote • United StatesMid-LevelSenior💰 $115,000 - $159,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and operating LLM-backed APIs, agentic AI, and retrieval-augmented generation (RAG) workflows, with a strong focus on backend services and distributed systems in cloud environments. Proficient in data-intensive systems and effective collaboration with product teams to translate goals into actionable plans.

Highest-signal resume keywords

Backend Services DevelopmentDistributed Systems ExperienceAgentic AI and RAG Production ExperiencePython, Java, or Go ProficiencyCloud Infrastructure Expertise

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Backend Services DevelopmentDistributed SystemsPythonJavaGoData-Intensive SystemsAPIsCloud Object StorageRelational DatabasesArchitectural Decision-Making

Soft Skills

Effective CommunicationProblem-SolvingStakeholder InvolvementOwnership

Tools & Technologies

AWSAzureGCPKubernetesContainersAI Coding Agents

Certifications & Qualifications

BS in Computer Science

Industry Keywords

LLM-Backed APIsRetrieval-Augmented GenerationEval WorkflowsIngestion PipelinesHigh-Throughput Data Paths

Tech Stack

Tools & technologies

AWSAzureCloudDistributed SystemsGoogle Cloud PlatformJavaKubernetesPythonGo

About the role

Key responsibilities & impact

Build and operate LLM-backed APIs, agents, retrieval systems, and integrations with internal and external systems
Develop evals for agent and RAG workflows and use results to improve quality and reliability
Build ingestion pipelines and high-throughput file and data paths between customer environments, cloud object storage, and compute clusters
Balance reliability, performance, and cost in data paths
Work with Product and Design to turn broad goals into clear problems, practical specifications, and small releases
Identify worthwhile improvements, involve the right stakeholders, ship frequently, and follow through on results
Work across backend services, cloud infrastructure, containers/Kubernetes, and occasional UI changes to complete the customer experience
Use Rescale’s product, identify workflow friction, and improve launched features

Requirements

What you’ll need

3–5 years of experience building and operating backend services and distributed systems in AWS, Azure, or GCP
Production experience with agentic AI, retrieval-augmented generation (RAG), and evals
Ability to explain how evaluations led to changes in a shipped system
Strong experience in at least one of Python, Java, or Go
Comfort working across services and APIs
Experience with data-intensive systems such as object storage, relational databases, caches, and queues or streams
Effective use of AI coding agents, including verifying their output
Ability to turn an ambiguous goal into a plan with Product
Sound architectural decision-making and ownership of post-launch performance
A BS in Computer Science or equivalent experience
Must successfully complete a comprehensive background check
Must answer whether visa sponsorship is required to work for Rescale in the United States

Benefits

Comp & perks

Equity
Equal opportunity employment
Comprehensive background check as part of the standard hiring process