AI Engineer

CACI International Inc

. Build, test, and support AI workflows and agents on an enterprise AI workflow management platform supporting the Department of the Air Force .

Posted 11/6/2026full-timeRemote • United StatesSeniorLead💰 $114,600 - $252,100 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and supporting AI workflows and agents within Azure IL-5 environments, integrating with ServiceNow and employing advanced AI frameworks. Proficient in translating complex requirements into effective solutions while ensuring compliance with DoD standards and security policies.

Highest-signal resume keywords

AI Workflow DevelopmentAzure Cloud ServicesPython ProgrammingRAG Pipeline DevelopmentServiceNow Integration

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

LLM ApplicationsPrompt EngineeringAgentic WorkflowsTest AutomationREST API DevelopmentVector DatabasesMLOps PracticesData ModelingWorkflow OrchestrationDocument Generation

Soft Skills

CommunicationProblem-SolvingCollaboration

Tools & Technologies

Azure OpenAIMicrosoft AI FoundryDockerKubernetesLangChainLlamaIndexServiceNow Flow DesignerPostgreSQLCI/CD for MLDevOps

Certifications & Qualifications

Sec+ CertificationServiceNow Development Certification

Industry Keywords

DoD ComplianceIL-4/IL-5FedRAMPNIST 800-53STIGsATO ProcessesGovernment CloudAzure GovernmentAWS GovCloudCUI Handling

Tech Stack

Tools & technologies

AWSAzureCloudCyber SecurityDockerKubernetesPostgresPythonServiceNow

About the role

Key responsibilities & impact

Build, test, and support AI workflows and agents on an enterprise AI workflow management platform supporting the Department of the Air Force
Work with the AI Platform Architect to turn platform designs and government use cases into tested, production-ready solutions in Azure IL-5 cloud environments integrated with ServiceNow
Build within established frameworks, patterns, and tools, including Microsoft AI Foundry and third-party agentic platforms
Translate customer mission needs into working prototypes and deployed workflows
Develop RAG pipelines, including document ingestion, chunking, embedding, vector search, and retrieval tuning
Build prompt chains, tool calls, and agent logic for document generation, summarization, and task automation
Integrate AI workflows with Azure OpenAI, ServiceNow APIs, and internal data sources
Build reusable components, templates, and connectors for technical and non-technical users
Implement workflow orchestration and business process automation
Develop and execute unit, integration, and user acceptance test plans
Build evaluation datasets and automated evaluation harnesses for LLM outputs
Define and track success metrics and evaluation criteria
Identify, document, and triage defects, hallucinations, and performance issues; drive root-cause analysis and remediation
Perform regression testing when models, prompts, or platform components change
Partner with the AI Platform Architect to implement designs, evaluate tools, and provide feedback
Prototype solutions and proofs-of-concept for government use cases and present results to customers and stakeholders
Troubleshoot integration issues across Azure, ServiceNow, and government networks with ServiceNow developers and Azure cloud engineers
Contribute to design reviews, engineering standards, and technical documentation
Support technical screening of AI/ML talent when requested
Support monitoring, logging, and alerting for AI workflows and agents
Manage prompt and model versioning and support CI/CD deployments of AI services
Monitor output quality, model drift, and data quality in production workflows and report findings
Track model and compute usage costs and recommend optimizations
Build and operate within DISA STIGs, IL-5 requirements, and Department of the Air Force security policies
Implement CUI handling and data classification controls in AI workflows
Provide engineering evidence and documentation to cybersecurity teams for ATO and continuous monitoring

Requirements

What you’ll need

US Citizenship required
Ability to obtain and maintain a secret clearance
15+ years of relevant experience
Bachelor’s Degree in a relevant field may be substituted for 5 years of relevant experience
Hands-on experience building LLM applications, including RAG, prompt engineering, and agentic workflows
Proficiency in Python, plus experience with LangChain, LlamaIndex, or similar AI frameworks
Experience with Azure cloud services, including Azure OpenAI, AI Foundry, DevOps, and API Management
Experience with Docker and REST API development and integration
Working knowledge of vector databases and embedding strategies
Experience with test automation and QA for software or AI systems
Experience with ServiceNow integration or scripting, including Flow Designer, REST APIs, or development
Ability to translate requirements into working solutions and communicate technical results to non-technical stakeholders
Familiarity with workflow orchestration tools and business process automation
Active Secret clearance (desired)
Top Secret eligibility (preferred)
Experience in government cloud environments, such as Azure Government or AWS GovCloud
Experience with Kubernetes or Azure Kubernetes Service (AKS)
Familiarity with DoD compliance frameworks, including IL-4/IL-5, FedRAMP, NIST 800-53, and STIGs
Experience with MLOps tools and practices, including MLflow, CI/CD for ML, and model monitoring
Experience with PostgreSQL and data modeling for AI workloads
Experience with ATO processes and security accreditation
Experience with ServiceNow Flow Designer or ServiceNow development certification
Sec+ certification

Benefits

Comp & perks

Flexible time off benefit
Robust learning resources
Healthcare benefits
Wellness benefits
Financial benefits
Retirement benefits
Family support benefits
Continuing education benefits
Time off benefits
Competitive compensation
Learning and development opportunities