Senior Manager, AI Engineer – Gen AI Platform Services, Agentic AI, Guardrails, Evaluation

Capital One

. Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products .

Posted 9/18/2026full-timeNew York City • California • United StatesSenior💰 $229,900 - $286,200 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing and deploying AI and ML algorithms, with a strong focus on LLM inference, similarity search, and responsible AI practices. Proven ability to lead multidisciplinary teams, optimize AI systems for scalability and performance, and translate enterprise goals into actionable roadmaps.

Highest-signal resume keywords

AI/ML TechnologiesProgramming Experience in Python, C++, C#, Java, CUDA, or GolangPeople Leadership ExperienceExperience with MLOps and AI ObservabilityExperience Deploying Scalable AI Solutions on Cloud Platforms

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI/ML AlgorithmsLLM InferenceSimilarity SearchFoundation-Model OptimizationAgentic AI SystemsMLOpsModel GovernanceEvaluation PipelinesDrift MonitoringTechnical Strategy Development

Soft Skills

Excellent Communication SkillsPresentation SkillsMentoring

Tools & Technologies

Cloud PlatformsVectorDBsAI Software ComponentsCollaboration Interfaces

Industry Keywords

Responsible AIModel LifecycleTechnical VisionProductizationScalability

Tech Stack

Tools & technologies

CloudJavaPythonC++Go

About the role

Key responsibilities & impact

Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
Oversee design, development, testing, deployment, and support of AI software components
Work across foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
Make build-versus-buy decisions across open-source and SaaS AI technologies
Develop foundation-model optimization techniques to improve scalability, cost, latency, and throughput
Contribute to the technical vision and long-term roadmap for foundational AI systems
Attract and retain AI talent and support team members’ personal and professional development
Translate enterprise AI goals into team roadmaps with measurable outcomes and regular readouts
Operationalize Responsible AI through review gates, documentation and evaluation requirements, and rollout/rollback standards
Create collaboration interfaces with Research, Data, and Platform teams to accelerate the model lifecycle

Requirements

What you’ll need

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, OR a Master's degree in those fields plus at least 4 years of relevant experience
At least 1 year of people leadership experience
Preferred: 3 years of experience managing and leading an engineering team
Preferred: 6 years of experience deploying scalable and responsible AI solutions on cloud platforms
Experience with AI/ML technologies including LLM inference, similarity search, VectorDBs, guardrails, and memory
Programming experience using Python, C++, C#, Java, CUDA, or Golang
Experience building agentic AI systems and workflows
Experience with AI research and applying novel techniques in production
Excellent communication and presentation skills
Experience leading technical strategy for a multidisciplinary AI team
Familiarity with MLOps, AI observability, evaluation pipelines, drift monitoring, and model/version governance
Track record mentoring engineers/scientists to productize prototypes and meet production SLOs
Experience right-sizing models, instance counts, and hardware types
Capital One will consider sponsoring a new qualified applicant for employment authorization

Benefits

Comp & perks

Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI)
Comprehensive health, financial, and other benefits supporting total well-being
Reasonable accommodations for applicants who require them