Software Engineering Evaluator, Contract

Recruit Recruit Ltd

. Design task-specific grading criteria for feature implementations, bug fixes, refactors, tests, and code reviews .

Posted 10/26/2026contractRemote • California • United States, Canada, United KingdomJuniorMid-Level💰 $50 - $125 per hourWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates strong software engineering capabilities with a focus on code evaluation, debugging, and performance assessment. Proficient in applying consistent judgment and clear communication in technical evaluations.

Highest-signal resume keywords

Python ProgrammingJavaScript/TypeScript ProgrammingCode Review ExperienceData Structures and AlgorithmsExcellent Written English

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringProduction Code ShippingTestingDebuggingVersion Control

Soft Skills

Ability to Reason Through AmbiguityAbility to Follow Complex InstructionsAbility to Learn New Tools QuicklyAbility to Take Feedback WellIndependent Work

Industry Keywords

AI-Generated Code EvaluationEdge-Case HandlingSecurity AssessmentPerformance AssessmentReadability in Coding

Tech Stack

Tools & technologies

JavaJavaScriptPythonTypeScriptC++Go

About the role

Key responsibilities & impact

Design task-specific grading criteria for feature implementations, bug fixes, refactors, tests, and code reviews
Evaluate AI-generated code for correctness, including failures that pass the code's own tests
Assess edge-case handling, security, performance, and readability in coding deliverables
Write clear, evidence-based justifications for every evaluation score
Apply consistent judgment across software engineering evaluation tasks
Review code that may appear correct and run without failing while identifying subtle defects
Reason through ambiguity and distinguish clearly between known facts and inferences during evaluations
Iterate on evaluation work based on feedback from senior reviewers

Requirements

What you’ll need

2–3 years of professional software engineering experience shipping production code
Strong command of at least one of Python, JavaScript/TypeScript, Java, Go, C++, C#, or a comparable language
Solid grounding in data structures, algorithms, testing, debugging, and version control
Experience reviewing other engineers' code
Excellent written English
Ability to follow complex instructions, reason through ambiguity, and spot subtle errors in code that looks correct and runs without failing
Ability to clearly separate what you know from what you are inferring
Ability to work independently, learn new tools quickly, and take feedback well
Based in and working from the US, Canada, or UK
Available for 10+ hours per week for the full 12 weeks

Benefits

Comp & perks

Paid weekly via Stripe or Wise
Remote work on your own schedule within the 10+ hour weekly engagement
Initial 12-week contract with the possibility that projects may be extended based on needs and performance
Opportunity to evaluate AI systems for leading AI research organizations
Reasonable accommodations available upon request