Software Engineer – AI Evaluation

Board Intelligence

. Design and build the AI evaluation suite used to measure and improve AI output quality .

Posted 10/12/2026full-timeRemote • United KingdomMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building AI-powered products and tools, with a strong focus on quality measurement and evaluation practices. Proficient in full-stack development, including data pipelines and backend services, while effectively collaborating with non-engineers to translate expertise into functional software.

Highest-signal resume keywords

AI Product DevelopmentFull-Stack DevelopmentQuality Measurement PracticesCollaboration with Non-EngineersExperience with Python and TypeScript

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringAI ToolingData Pipeline DevelopmentBackend ServicesFront-End DevelopmentTesting FrameworksEvaluation Suite DevelopmentAutomation of Evaluation ProcessesAttention to DetailQuality Assurance

Soft Skills

Independent WorkAdaptabilityCollaborationCommunication

Tools & Technologies

AI Coding ToolsSoftware Development Lifecycle (SDLC)

Industry Keywords

AI Quality MeasurementEvaluation StandardsStartup ExperienceEnd-to-End Development

Tech Stack

Tools & technologies

PythonSDLCTypeScript

About the role

Key responsibilities & impact

Design and build the AI evaluation suite used to measure and improve AI output quality
Build across the full stack, including data pipelines, backend services and front-end tools
Work with prompt engineers and subject matter experts to turn knowledge into tests, metrics and tooling
Help define AI quality measurement practices
Automate evaluation processes and results within the software development lifecycle
Contribute over time to AI-powered products
Deliver an evaluation suite used by engineering teams after three months
Extend evaluations across all AI products and integrate them into the SDLC after six months
Establish evaluation as a standard part of AI delivery and become a trusted voice on AI quality after twelve months

Requirements

What you’ll need

Upper mid-level to senior professional software engineering experience
Experience building AI powered products or tooling
Full-stack experience across front end and back end
Comfortable working independently and in ambiguity, setting own direction
Experience collaborating with non-engineers and turning their expertise into working software
Strong focus on quality, testing and attention to detail
Experience using AI coding tools in day-to-day work
Fluent written and spoken English
Nice to have: experience building evaluation suites for AI products
Nice to have: experience with Python and TypeScript
Nice to have: experience building internal tools, testing frameworks or data pipelines
Nice to have: experience at a startup or in a small team building things end to end

Benefits

Comp & perks

Pension scheme
Personal performance bonus
26 days holiday each calendar year
Bupa health & dental cover
Group life assurance
EAP
Cycle to work scheme
Diversity, equity and inclusion
Reasonable adjustments accommodated during the hiring process