Lead Research Engineer – AI Evaluation, Benchmarking

Thomson Reuters

. Lead technical delivery and engineering planning .

Posted 10/30/2026full-timeUnited StatesSenior💰 $127,400 - $236,600 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive experience in leading technical delivery and engineering planning, with a strong focus on Python programming, API design, and machine learning model evaluation. Capable of integrating automated testing and deployment while collaborating effectively across teams.

Highest-signal resume keywords

Python ProgrammingTechnical LeadershipMachine Learning Model EvaluationCloud Engineering (AWS, Azure)Automated Testing and Deployment

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Python ProgrammingAPI DesignAutomated TestingSQLMachine Learning IntegrationData Processing (Structured and Unstructured)Evaluation Framework DevelopmentAutomated Evaluation PipelinesPerformance MeasurementScalability Solutions

Soft Skills

CollaborationCommunicationProblem-SolvingMentoring

Tools & Technologies

AWSAzureAutomated Deployment ToolsMonitoring Tools

Industry Keywords

Software EngineeringTechnical DeliveryEngineering PlanningData EngineeringResearch Collaboration

Tech Stack

Tools & technologies

AWSAzureCloudPythonSQL

About the role

Key responsibilities & impact

Lead technical delivery and engineering planning
Define priorities, delivery stages, effort and cost estimates, staffing needs, dependencies, and resource adaptations
Extend shared tools and services and design new scalable evaluation infrastructure
Develop production-quality Python software, APIs, and reusable evaluation frameworks
Build automated evaluation pipelines connecting model APIs, test datasets, and scoring methods
Implement reliable workflows for comparing LLMs and other AI models
Maintain repeatable experiments and traceable evaluation results
Measure model quality, operating cost, and latency
Develop user interfaces, documentation, evaluation reports, and diagnostic capabilities
Integrate automated testing, deployment, and monitoring
Address performance, scalability, operating costs, maintenance, support ownership, access controls, permitted-use rules, and retention requirements
Collaborate with research, data engineering, platform engineering, and product teams
Resolve technical dependencies, mentor engineers, communicate trade-offs and delivery risks, and guide scope or technical approach

Requirements

What you’ll need

8-10+ years of relevant software engineering experience, including production systems involving machine learning or complex data
Strong hands-on Python programming skills, including API design, automated testing, and structured and unstructured data
Technical leadership and end-to-end delivery experience, including architecture decisions, engineering planning, staffing, effort estimation, project execution, and adapting priorities
Experience collaborating with research scientists or machine learning practitioners
Experience integrating or testing machine learning models and interpreting evaluation results
Understanding of language models and unreliable comparisons or test-data leakage
Cloud engineering experience using AWS, Azure, or a comparable platform
Experience with distributed workflows, automated deployment, and monitoring
Working knowledge of SQL
Experience developing software processing structured and unstructured data
Strong collaboration, communication, problem-solving, and mentoring skills
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience

Benefits

Comp & perks

Flexible hybrid working environment
Work from anywhere for up to 8 weeks per year
Flexible vacation
Two company-wide Mental Health Days off
Headspace app access
Retirement savings
Tuition reimbursement
Employee incentive programs
Resources for mental, physical, and financial wellbeing
Two paid volunteer days off annually
Pro-bono consulting opportunities
Environmental, Social, and Governance (ESG) initiatives
Health, dental, vision, disability, and life insurance programs
Competitive 401k plan with company match
Competitive vacation, sick and safe paid time off
Paid holidays, including two company mental health days off
Parental leave
Sabbatical leave
Optional hospital, accident and sickness insurance
Optional life and AD&D insurance
Flexible Spending and Health Savings Accounts
Fitness reimbursement
Employee Assistance Program
Group Legal Identity Theft Protection benefit
529 Plan access
Commuter benefits
Adoption & Surrogacy Assistance
Employee Stock Purchase Plan
Annual bonus eligibility based on enterprise and individual performance