Research Scientist, Benchmarks & Evals

Kled AI

. Design and ship public benchmarks for image, video and document models .

Posted 10/11/2026full-timeRemote • United StatesMid-LevelSenior💰 $150,000 - $250,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in machine learning research and engineering, particularly in training and fine-tuning image and video models using PyTorch. Proficient in experimental design, statistical analysis, and clear communication of findings to both researchers and stakeholders.

Highest-signal resume keywords

Machine Learning Research ExperienceImage And Video Model TrainingExperimental Design And StatisticsPublications At NeurIPS, ICML, ICLR, CVPRData Valuation Or Attribution Research

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Machine LearningModel EvaluationExperimental DesignStatistical AnalysisData CollectionModel Fine-TuningPythonPyTorchPostgreSQLS3 Storage

Soft Skills

Clear WritingCollaboration

Tools & Technologies

Cloud GPUsOpen-Weight ModelsSupabase

Industry Keywords

Data DealsHuman Evaluation StudiesData AttributionAI LabsBenchmarks

Tech Stack

Tools & technologies

CloudPostgresPythonPyTorch

About the role

Key responsibilities & impact

Design and ship public benchmarks for image, video and document models
Build private test sets from real, opt-in data that no model has trained on
Run data-value experiments by training models with and without Kled data and measuring changes
Design human evaluation studies and automatic metrics
Publish leaderboards and reports trusted by researchers at frontier labs
Identify model shortcomings and advise what data to collect next
Work directly with founders and lab buyers to turn results into data deals

Requirements

What you’ll need

3+ years ML research or research engineering experience
A benchmark or evaluation you built that other people actually used
Strong hands-on experience training and fine-tuning image or video models (PyTorch)
Deep understanding of experimental design and statistics (controls, ablations, human studies)
Experience running experiments end to end, from GPUs to final report
Clear writing for both researchers and buyers
Publications at NeurIPS, ICML, ICLR or CVPR (datasets and benchmarks especially) (bonus)
Experience on an evaluation or data team at an AI lab (bonus)
Experience selling or licensing data to AI labs (bonus)
Experience with data valuation or data attribution research (bonus)
Python / PyTorch
Open-weight image and video models
Cloud GPUs
PostgreSQL (Supabase)
S3 storage

Benefits

Comp & perks

$350,000 – $750,000 equity
0.25% – 1% equity