AI Assurance Lead, LLM Evaluation, Fine Tuning, Model Risk

Intelance

. Map where AI sits in a product, distinguishing plain code, machine learning and language-model components .

Posted 11/11/2026contractLondon • United KingdomSenior💰 £650 - £800 per dayWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in evaluating and assuring machine learning and language model systems, with a strong focus on fine-tuning open source models and designing evaluation suites. Proficient in communicating model risks clearly to diverse stakeholders and familiar with relevant regulatory frameworks.

Highest-signal resume keywords

Machine Learning System EvaluationFine Tuning Open Source ModelsDesigning Evaluation SuitesISO/IEC 42001 KnowledgeNIST AI Risk Management Framework

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Machine LearningLanguage Model SystemsModel ValidationEvaluation ApproachesTest SuitesAccuracy MeasuresPrompt Injection ControlsData Leakage PreventionFailure RemediationRegulated Data Experience

Soft Skills

Clear CommunicationStakeholder Engagement

Industry Keywords

AI Risk ManagementEU AI ActDue DiligenceAudit ExperienceClinical Data

Tech Stack

Tools & technologies

Open Source

About the role

Key responsibilities & impact

Map where AI sits in a product, distinguishing plain code, machine learning and language-model components
Review fine tuning of open source models, training data and whether client contracts permit its use
Test evaluation approaches, including test suites, accuracy measures, human review rules and failure remediation
Check controls against prompt injection, data leakage between clients and model tampering
Check reliance on external AI providers and what data they receive
Rate findings by potential deal impact and write clear, practical fixes
Report to an Intelance engagement partner
Work with the technology due diligence lead to incorporate findings into the final report
Deliver approximately 3 to 5 days of work between late November 2026 and the end of January 2027, with potential further engagements

Requirements

What you’ll need

At least five years building, evaluating or assuring machine learning or language model systems
Hands-on experience fine tuning open source language models
Experience designing evaluation suites
Working knowledge of ISO/IEC 42001, the NIST AI Risk Management Framework or the EU AI Act
Ability to explain model risk in plain words to founders, buyers and lawyers
Experience with health, clinical or other regulated data is a strong plus
Experience of due diligence, audit or model validation work is a strong plus
Remote within the UK
Freelance or through your own limited company
Must sign a panel agreement, NDA and statement of work before client details are shared

Benefits

Comp & perks

Reasonable travel costs for client meetings are covered
Use of an Intelance mailbox
Access to Intelance evidence log and report templates
Panel agreement, NDA and statement of work signed before client details are shared