AI Engineer II

Guidewire Software

. Build, evaluate, and harden Guidewire Concierge, an omnichannel AI agent for P&C insurance carriers .

Posted 11/2/2026full-timeRemote • United StatesMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and deploying AI applications, particularly in the context of LLMs and omnichannel AI agents for P&C insurance. Proficient in evaluation methodologies, error analysis, and designing scalable systems while maintaining a strong commitment to security and privacy.

Highest-signal resume keywords

LLM Application DevelopmentError AnalysisStatistical MeasurementDistributed Systems DesignCI/CD Process Automation

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI Application DevelopmentContext EngineeringMachine LearningDeep LearningSoftware Engineering FundamentalsData Store DesignTestingStatistical MeasurementEvaluation MethodologiesAgentic Workflows

Soft Skills

AdaptabilityProduct SenseCollaboration

Tools & Technologies

GuidewireLiveKitSIP TelephonyASRTTSSBCSIPREC

Industry Keywords

P&C InsuranceClaimsRegulated DomainInternal EvaluationObservability Tooling

Tech Stack

Tools & technologies

Distributed SystemsGuidewire

About the role

Key responsibilities & impact

Build, evaluate, and harden Guidewire Concierge, an omnichannel AI agent for P&C insurance carriers
Own end-to-end slices of the agent, including prompt and context architecture, retrieval over policy and coverage data, tool and API calls into core claims systems, and human handoff
Build and run the evaluation loop, including golden sets, trajectory evaluation, LLM-as-judge, and error analysis on production call traces
Make evaluation systems gate product releases
Increase containment and resolution rates while preserving accuracy
Instrument the system to measure containment and accuracy changes
Work on the voice path, including turn-taking, interruption, latency budgets, and the LiveKit/SIP telephony layer
Attend carrier calls and listen to recordings to identify conversation failures and improvements
Help shape product direction, agent behavior, MVP scope, and claims workflows

Requirements

What you’ll need

Experience building and deploying AI applications used by real users
Shipped an LLM application that real users depend on
Fluency in LLMs, context engineering, RAG, and agentic workflows
Real ML and deep learning depth
Experience with disciplined evaluations, error analysis, and statistical measurement
Software engineering fundamentals
Ability to reason about cost, latency, reliability, and scalability tradeoffs
Experience designing data stores and distributed systems
Ability to write tests
Commitment to security and privacy
Advocacy for CI/CD process automation
Experience working with coding agents daily
Product sense and enough insurance context to shape agent behavior and workflows
Ability to keep learning and adapt to changing AI tooling
Nice to have: real-time or streaming voice systems, including ASR, TTS, telephony, SBC/SIPREC
Nice to have: insurance, claims, or another regulated domain experience
Nice to have: internal evaluation or observability tooling experience
Nice to have: machine learning principles or experience experimenting with, training, and deploying models in production
Nice to have: P&C Insurance or Guidewire products and services exposure
Nice to have: DSPy or GEPA applied to a production system

Benefits

Comp & perks

Health, dental, and vision insurance
Paid time off
Company sponsored retirement plan
Some roles may be eligible for the annual company bonus plan
Some roles may be eligible for commissions
Some roles may be eligible for long term incentive awards
Individualized accommodations and support during the hiring process