FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in evaluating AI-generated coding interactions, providing clear feedback, and defining engineering standards. Proficient in TypeScript, JavaScript, or Python, with a strong understanding of AI-assisted development workflows.
Highest-signal resume keywords
TypeScriptJavaScriptPythonOpenAI CodexClaude Code
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
AI-Assisted Development WorkflowsCode EvaluationEngineering Quality StandardsPrompt DesignEvaluation Workflows
Soft Skills
Written CommunicationSpoken CommunicationFeedback Delivery
Tools & Technologies
CursorLoom
Industry Keywords
Software EngineeringSenior EngineerStaff EngineerPrincipal Engineer
Tech Stack
Tools & technologiesJavaScriptPythonTypeScript
About the role
Key responsibilities & impact- Evaluate AI-generated coding interactions end to end
- Judge whether outputs are useful, correct at a high level, and aligned with strong engineering judgment
- Assess explanations and reasoning, not just code
- Distinguish between different levels of response quality
- Provide clear, opinionated written feedback on what worked, failed, or felt misleading
- Help define what excellent interaction looks like for Cursor, Codex, and Claude Code
- Record short video explanations of evaluations
- Work on projects lasting approximately two weeks to a few months
Requirements
What you’ll need- Senior, Staff, or Principal-level software engineer, or equivalent experience
- Strong background in TypeScript/JavaScript or Python
- Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor
- Deep familiarity with modern AI-assisted development workflows
- Ability to evaluate code without executing it or reviewing every line
- Strong written and spoken English at B2 level or above
- Comfortable giving direct, opinionated feedback
- High standards for engineering quality
- Nice to have: prior exposure to prompt design or evaluation workflows
- Nice to have: experience mentoring senior engineers or defining engineering standards
- Must complete a take-home evaluation exercise with a recorded Loom walkthrough
- Simple background check required
Benefits
Comp & perks- Flexible hours, 10–20 hours/week
- Ongoing project opportunities for evaluators who perform well
- Remote work worldwide, subject to regional client eligibility
- Start as soon as the take-home is cleared and a project seat is available
