AI/ML Engineer II

BLUE ORIGIN

. Design and build multi-agent systems for incident triage and root cause analysis using specialized agents coordinated by a central orchestrator .

Posted 11/3/2026full-timeUnited StatesJuniorMid-Level💰 $134,961 - $188,945 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and building multi-agent systems for incident triage and root cause analysis, with a strong focus on AI infrastructure management using AWS services. Proficient in developing LLM-based applications and implementing evaluation frameworks for agent performance.

Highest-signal resume keywords

Multi-Agent System DesignLLM-Based Application DevelopmentAWS Services ProficiencyInfrastructure As CodeEvaluation Frameworks Development

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Python ProgrammingPrompt EngineeringTool Use or Function CallingRetrieval-Augmented GenerationAPI DevelopmentIncident ResponseEvaluation HarnessesAgent Communication DesignOperational DocumentationKnowledge Base Management

Soft Skills

Clear CommunicationCollaboration

Tools & Technologies

AWS CDKCloudFormationTerraformOpenSearchDynamoDBCloudWatchLambdaS3Observability Tools

Certifications & Qualifications

Bachelor's Degree in Computer ScienceBlue’s Standard Background Check

Industry Keywords

Incident TriageRoot Cause AnalysisAI InfrastructureContinuous ImprovementAgent Accuracy Metrics

Tech Stack

Tools & technologies

AWSCloudDynamoDBPythonTerraform

About the role

Key responsibilities & impact

Design and build multi-agent systems for incident triage and root cause analysis using specialized agents coordinated by a central orchestrator
Build and maintain knowledge bases over internal documentation, runbooks, and escalation paths
Develop ingestion pipelines, chunking and retrieval strategies, and relevance evaluation
Provision and manage AI infrastructure as code with AWS CDK across environments
Define evaluation frameworks and metrics for agent accuracy, hallucination rate, tool-call correctness, latency, and cost
Drive continuous improvement of AI agents and workflows
Partner with engineers and domain teams to turn real incident patterns into new tools, agents, and knowledge content
Document agent architectures, tool interfaces, guardrails, and operational runbooks
Take AI/ML tooling from prototype to audited production deployment for edge-to-cloud production systems

Requirements

What you’ll need

Bachelor's in Computer Science, Electrical Engineering, or a related field
2+ years of software or ML engineering experience, including production systems
Hands-on experience building LLM-based applications, including prompt engineering, tool use or function calling, and retrieval-augmented generation (RAG)
Experience with AWS services such as Lambda, S3, DynamoDB, CloudWatch, and IAM
Programming skills in Python, with experience building APIs and services
Experience with infrastructure as code (AWS CDK, CloudFormation, or Terraform)
Familiarity with observability concepts: logs, metrics, traces, alerting, and incident response
Ability to write clear design documents, interface definitions, and operational documentation
U.S. citizenship or nationality, U.S. permanent residency, or lawful admission into the U.S. as a refugee or asylee required by export control regulations
Blue’s Standard Background Check required for all positions
Desired: experience designing multi-agent orchestration patterns and agent-to-agent communication
Desired: experience with OpenSearch or other vector and hybrid search systems
Desired: experience building evaluation harnesses for LLM and agent systems, including offline benchmarks and LLM-as-judge methods

Benefits

Comp & perks

Medical, dental, and vision insurance
Basic and supplemental life insurance
Paid parental leave
Short- and long-term disability
401(k) with a company match of up to 5%
Education Support Program
Stock Options for all regular employees working at least 20 hours/week
Up to four weeks of paid time off per year based on weekly scheduled hours
Up to 14 company-paid holidays
Potential eligibility for benefits and bonuses based on role type and job level
Reasonable accommodation for applicants requiring it during the application/interview process