FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and operating AI capabilities, focusing on production quality, evaluation, and cost management. Proficient in collaborating with cross-functional teams to deliver reliable AI solutions that create real business value.
Highest-signal resume keywords
Experience Shipping Software Backed By LLMsStrong Understanding Of RAG And Evaluation ApproachesExperience Building Guardrails And Controls For AI SystemsStrong Software Engineering SkillsExperience With AI Development Lifecycle Practices
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Agent Runtime DesignModel RoutingTool/Function CallingEvaluation HarnessesPrompt DesignCost ManagementLatency OptimizationMonitoring Production AI BehaviorAI Workflow PatternsSemantic Knowledge Management
Soft Skills
Strong Communication SkillsCollaboration SkillsPragmatic Mindset
Tools & Technologies
ClaudeGPTAzure OpenAIOpen-Source ModelsMCPA2AMulti-Agent OrchestrationAI Tool CallingAI-Assisted Development ToolsKnowledge Graphs
Industry Keywords
AI CapabilitiesProduction Quality ControlsEvaluation DisciplineCost Aware AIContinuous Improvement
Tech Stack
Tools & technologiesAzure
About the role
Key responsibilities & impact- Build and operate AI capabilities across an enterprise platform
- Work with agent runtimes, model routing, RAG, tool/function calling, guardrails, evaluation, monitoring, cost management, latency optimization, and production quality controls
- Ship AI capabilities that work reliably in production rather than demos
- Move AI systems from prototype to monitored production systems
- Evaluate AI behavior rigorously and build evaluation discipline into delivery processes
- Partner with product and engineering teams to determine when AI is appropriate and when it is not
- Turn experiments into production features
- Help client teams make informed decisions about where AI creates real value
- Deliver AI capabilities that are useful, reliable, measurable, safe, and cost aware
Requirements
What you’ll need- Experience shipping software backed by LLMs, ML models, RAG systems, or agentic workflows to real production users
- Experience designing or implementing agent runtime, orchestration, model routing, tool/function calling, or AI workflow patterns
- Strong understanding of RAG, grounding, retrieval quality, prompt design, context management, and evaluation approaches
- Experience building evaluation harnesses, golden sets, regression checks, quality gates, or measurable AI performance frameworks
- Ability to treat cost, latency, reliability, and safety as first-class engineering constraints
- Experience building guardrails and controls for AI systems, including untrusted retrieved content, tool output risk, and failure modes
- Experience monitoring production AI behavior and improving systems based on evidence, not opinion
- Strong software engineering skills and ability to collaborate with backend, platform, product, and security teams
- Strong communication and collaboration skills for client-facing consulting environments
- Pragmatic mindset with the ability to prioritize business value and ship useful AI capabilities quickly and responsibly
- Experience with Claude, GPT, Azure OpenAI, open-source models, model routing, fine-tuning, distillation, or small/edge models
- Experience with MCP, A2A, multi-agent orchestration, AI tool calling, or agent evaluation
- Experience with LLM-as-judge approaches calibrated against human evaluation
- Experience with semantic knowledge management, ontologies, knowledge graphs, or semantic layers
- Experience with AI development lifecycle practices across data, build, evaluation, deployment, monitoring, and continuous improvement
- Experience using AI-assisted development tools while maintaining strong review, testing, and safety discipline
Benefits
Comp & perks- Remote work arrangement
- Permanent employee position
- Direct-hire employment
- Opportunity to work with a global multi-billion dollar software conglomerate client