Head of Agent Engineering

Baker Tilly US

. Define and build agentic reference patterns for task decomposition, orchestration, context engineering, memory management, tool use, human-in-the-loop checkpoints, and failure containment and recovery .

Posted 10/21/2026full-timeUnited StatesLead💰 $250,000 - $400,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive experience in building and deploying LLM-based and agentic systems, with a strong focus on evaluation methodologies, orchestration frameworks, and full-stack product engineering. Proven ability to lead engineering teams, establish technical standards, and collaborate across multiple disciplines to drive successful product outcomes.

Highest-signal resume keywords

LLM-Based Systems DevelopmentEvaluation MethodologiesOrchestration FrameworksFull-Stack Product EngineeringAgentic System Design

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringEvaluation Harness DesignRegression TestingPython ProgrammingTypeScript ProgrammingOrchestration StandardsHuman-In-The-Loop WorkflowsMemory ManagementTool UseFailure Containment

Soft Skills

CollaborationMentoringLeadershipCommunicationStakeholder Engagement

Tools & Technologies

Agentic Development ToolsObservability ToolsTracing ToolsEvaluation StandardsAgent Pattern Library

Industry Keywords

Agentic SystemsProduct EngineeringTechnical StandardsThird-Party EvaluationContext Engineering

Tech Stack

Tools & technologies

PythonTypeScript

About the role

Key responsibilities & impact

Define and build agentic reference patterns for task decomposition, orchestration, context engineering, memory management, tool use, human-in-the-loop checkpoints, and failure containment and recovery
Maintain the agent pattern library and establish orchestration standards for product teams
Own BT Compass end to end, including its agentic workflows and full-stack product experiences
Build and own the evaluation harness, baselines, and regression discipline for iteration and release and acceptance decisions
Establish evaluation and acceptance criteria with Product, Architecture, Platform & Production Engineering, Quality Engineering, and other stakeholders
Partner with Platform & Production Engineering to scale evaluation capabilities in production
Lead and grow the Agent Factory, setting standards for agent design, engineering quality, and full-stack product development
Conduct hands-on design and code reviews and mentor engineers
Hire and develop full-stack, forward-deployed AI engineers
Translate leading agentic-engineering practices into Baker Tilly-owned standards, patterns, and runbooks
Direct third-party and partner engineers against Baker Tilly’s technical standards
Evaluate third-party and vendor agents against technical and evaluation standards
Partner with the Chief Architect to establish evaluation standards and promote proven patterns into the shared platform library
Collaborate with Data & AI Platform, Product, Design, Quality Engineering, Platform & Production Engineering, subject matter experts, and engineering teams in India
Engage in special projects and perform other duties as assigned

Requirements

What you’ll need

Bachelor’s degree in computer science, engineering, or a related field, or equivalent practical experience; advanced degree preferred
15+ years of software engineering experience
3+ years building and deploying LLM-based or agentic systems in production
Staff- or principal-level engineering experience with demonstrated success personally designing and shipping production agent systems
Deep experience designing and building evaluation harnesses and using evaluation results, baselines, and regression testing to drive iteration and release decisions
Strong knowledge of orchestration frameworks, tool/function calling and MCP, vector and graph retrieval, and context and memory management
Experience with evaluation methodologies, baselines, regression discipline, confidence frameworks, and LLM-as-judge patterns and limitations
Full-stack product engineering experience
Experience designing human-in-the-loop workflows, checkpoints, review experiences, and failure-containment mechanisms
Recent experience writing production-quality code in Python and/or TypeScript
Experience with observability and tracing for agentic systems
Experience directing third-party or partner engineers against established technical standards
Experience evaluating third-party technologies or vendor agents against internal technical and quality standards
Ability to use AI and agentic development tools in day-to-day engineering work
Ability to collaborate across engineering, product, design, platform, and business teams while translating emerging technical practices into repeatable standards
No certifications or licenses required

Benefits

Comp & perks

Compensation and benefits package for eligible employees