Staff Backend Engineer, AI Platforms

CVS Health Careers

. Design, build, and deploy scalable AI/GenAI applications leveraging LLMs, RAG architectures, and agentic frameworks .

Posted 11/10/2026full-timeRemote • Massachusetts • United StatesLead💰 $106,605 - $260,590 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and deploying scalable AI applications using LLMs and microservices architectures, with a strong focus on backend development, API integration, and software engineering best practices. Proven ability to lead technical discussions, mentor engineers, and collaborate across teams to deliver production-grade solutions.

Highest-signal resume keywords

AI/GenAI Application DevelopmentBackend Development with Java, Python, or Node.jsMicroservices and RESTful API DesignCloud Platforms (GCP, RKE)CI/CD and DevOps Practices

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringAPI DevelopmentPrompt EngineeringLLM Evaluation TechniquesMicroservices ArchitectureRAG ArchitecturesAngular FrameworkReact FrameworkContainerization (Docker/Kubernetes)Model Pipeline Development

Soft Skills

Technical LeadershipCollaborationMentoringCommunication

Tools & Technologies

Cloud-Native ArchitecturesCI/CD ToolsMonitoring ToolsObservability Frameworks

Industry Keywords

AI/MLLLM EcosystemsEnterprise Systems IntegrationSoftware Engineering Best Practices

Tech Stack

Tools & technologies

AngularCloudDockerGoogle Cloud PlatformJavaJavaScriptKubernetesMicroservicesNode.jsPythonReact

About the role

Key responsibilities & impact

Design, build, and deploy scalable AI/GenAI applications leveraging LLMs, RAG architectures, and agentic frameworks
Develop and optimize AI prompts, evaluation frameworks, and model pipelines
Architect and implement end-to-end solutions, including Angular/React frontend applications and backend APIs/services
Integrate AI capabilities into enterprise systems using cloud-native and microservices architectures
Lead technical design discussions and architecture decisions
Collaborate across product, business, and engineering teams
Build reusable frameworks and tooling for LLM evaluation, monitoring, and observability
Ensure software engineering best practices, including CI/CD, testing, code reviews, and security
Mentor and guide engineers
Stay current with AI/ML, LLM ecosystems, and modern web technologies

Requirements

What you’ll need

7+ years of experience in software engineering, delivering scalable, production-grade applications
5+ years of experience in backend development
API development using Java, Python, or Node.js
Experience designing and developing microservices and RESTful APIs
Hands-on experience with cloud platforms (GCP, RKE)
Strong understanding of CI/CD pipelines, DevOps practices, and containerization (Docker/Kubernetes)
Strong understanding of frontend frameworks including Angular, React, or similar
1+ years of hands-on experience with Generative AI / LLM-based systems
Experience with prompt engineering and LLM interactions
Experience with RAG architectures
Experience with LLM evaluation techniques and frameworks
Experience building AI-enabled applications using modern frameworks and tools
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience (High School diploma + 4 years of relevant experience)

Benefits

Comp & perks

Medical coverage
Dental coverage
Vision coverage
Paid time off
Retirement savings options
Wellness programs
Other resources supporting physical, emotional, and financial well-being
CVS Health bonus, commission or short-term incentive program
Equity award program