FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and building multi-step AI agents and evaluation frameworks, with a strong focus on reliability, accuracy, and integration with third-party platforms. Proven ability to mentor engineers and establish best practices in a cloud environment.
Highest-signal resume keywords
AI Agent DesignEvaluation FrameworksModel ServingCloud InfrastructureThird-Party Integrations
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Software EngineeringAI System OwnershipEvaluation PipelinesML Model OrchestrationReliability FeaturesMeasurement ToolingIdempotencyRetriesGraceful DegradationStructured Logging
Soft Skills
MentoringCollaborationComfort With AmbiguityLearning Specialized Domains
Tools & Technologies
EncompassDocuTechCloud EnvironmentObservability ToolsPrompt Pipelines
Industry Keywords
Mortgage FulfillmentAI WorkflowsTask CompletionIncident ResponseEngineering Best Practices
Tech Stack
Tools & technologiesCloud
About the role
Key responsibilities & impact- Design and build multi-step AI agents for mortgage Fulfillment workflows
- Build evaluation frameworks measuring agent reliability, accuracy, and task completion
- Improve prompts, models, and fallbacks using evaluation signals
- Architect and operate agent infrastructure including model serving, prompt pipelines, batching, queueing, and observability
- Build reliability features including idempotency, retries, graceful degradation, and structured logging
- Integrate with Encompass, DocuTech, and other third-party platforms
- Collaborate with Encompass administrators, Fulfillment operations, and Platform engineering partners
- Establish engineering best practices for testing, measurement, observability, and incident response
- Mentor engineers through code reviews and design discussions
- Own workstream architecture, surface tradeoffs, and drive technical decisions
Requirements
What you’ll need- Bachelor’s degree in Computer Science, Computer Engineering, or a related technical field, or an equivalent combination of education and experience
- 8+ years of professional software engineering experience
- Experience building and operating scalable, reliable services in a modern cloud environment
- Experience owning an AI or ML system in production end to end
- Hands-on experience in at least two of: designing and running evaluation pipelines; operating LLM or ML model serving and orchestrating multi-step AI workflows; building reliable third-party platform and external API integrations
- Strong infrastructure and AI knowledge
- Experience defining correctness measures and building measurement tooling
- Comfort with ambiguity and ability to learn specialized domains quickly
- Mortgage experience is not required
- Equivalent combination of education and experience accepted
Benefits
Comp & perks- Equity awards
- Remote work from a physical location of choice
- Flexible distributed work through Cloud HQ
- Accommodation support for disabilities or special needs