FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in leading AI data operations and project delivery, focusing on quality assurance, client communication, and workflow translation. Capable of mentoring teams and developing guidelines to enhance project consistency and effectiveness.
Highest-signal resume keywords
AI Data Operations ExperienceProject CoordinationData Quality AssuranceClient CommunicationWorkflow Translation
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Model Evaluation WorkflowData Quality StandardsAnnotation WorkflowsRubric DesignReinforcement Learning From Human FeedbackPreference Data AssessmentEvaluation CreationBenchmark Development
Soft Skills
Troubleshooting SkillsOrganizational SkillsStakeholder Management
Industry Keywords
GenAIFrontier AIAI ResearchQuality Assurance MethodsAI CompaniesModel Evaluation Programs
About the role
Key responsibilities & impact- Lead end-to-end project delivery, including scope, timelines, budgets, staffing, and risk management
- Lead client communication, status reporting, planning sessions, and escalations
- Translate model improvement objectives into data requirements, workflows, rubrics, and evaluation plans
- Define quality standards and acceptance criteria for preference data, model comparisons, and evaluation outputs
- Monitor delivery quality, investigate inconsistencies, and resolve ambiguous requirements with clients
- Advise on data design, evaluation approaches, and project feasibility based on domain expertise
- Develop reusable guidelines, SOPs, and QA frameworks to improve consistency across programs
- Mentor Operations Specialists and contribute to project scoping, pilots, and new capability development
- Help AI companies develop and improve frontier models through high-quality data programs
- Work closely with clients and internal teams to translate AI research needs into clear workflows, reliable datasets, and measurable outcomes
Requirements
What you’ll need- 1–2+ years of experience in AI data operations, project coordination, or delivery, ideally in a GenAI or frontier AI environment
- Familiarity with at least one AI post-training or model evaluation workflow
- Experience coordinating projects or workstreams, managing stakeholders, and communicating with clients
- Understanding of data quality, annotation workflows, and quality assurance methods
- Ability to translate evolving requirements into clear workflows, rubrics, and measurable quality standards
- Strong troubleshooting and organizational skills, with the ability to manage multiple priorities
- Interest in current AI developments, including frontier models and post-training approaches
- Experience with reinforcement learning from human feedback (RLHF), preference data, or model response evaluation is nice to have
- Familiarity with rubric design, model comparison, benchmark development, or evaluation creation is nice to have
- Experience assessing model responses for quality, accuracy, reasoning, or instruction following is nice to have
- Exposure to AI companies, frontier AI labs, or model evaluation programs is nice to have
- Bilingual capabilities, particularly German or a Nordic language, are nice to have
Benefits
Comp & perks- Permanent - Regular Full-time
- Remote work arrangement
- Flexibility to deliver in a way that works for you and your team
- Tools, resources, and development opportunities to build capability
- Opportunity to work on complex AI challenges across industries and geographies
- Collaborative culture valuing innovation, curiosity, accountability, excellence, and humility