Contract Student Worker – AI Validation and Benchmarking Engineer

Zoox

. Support the end-to-end validation pipeline for AI tools .

Posted 10/13/2026full-timeFoster City • California • United StatesEntry Level💰 $30 per hourWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in AI tool validation, including the development of evaluation dimensions and analysis of benchmark results. Proficient in Python and familiar with structured data formats, contributing to the enhancement of autonomous technology evaluation.

Highest-signal resume keywords

Python ProgrammingEvaluation ConceptsData AnalysisLLM-Based Systems ExposureJira or Slack Experience

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Collection AutomationResult ParsingMetric ReportingBenchmark Pipeline MaintenanceTest Dataset ManagementScript WritingStructured Data HandlingEvaluation Dimension DevelopmentFailure Mode InvestigationAgent Output Evaluation

Soft Skills

DocumentationTrend TrackingTeam CollaborationCommunication

Tools & Technologies

CursorClaudeJiraSlack

Industry Keywords

AI ToolsBenchmark ValidationAgent VariantsLabel AccuracyStructured Output CorrectnessPrecisionRecallF1 ScoreConfusion MatricesAutonomous Technology

Tech Stack

Tools & technologies

Python

About the role

Key responsibilities & impact

Support the end-to-end validation pipeline for AI tools
Maintain test datasets
Run and maintain benchmark pipelines and analyze results to identify routing errors and regressions across agent variants
Build and expand ground truth datasets used to evaluate agent outputs against known-correct answers
Identify and address gaps in benchmark validation and support comprehensive evaluation infrastructure
Develop evaluation dimensions such as label accuracy and structured output correctness
Investigate failure modes in agent outputs and work with engineers to surface actionable improvements
Write scripts and tooling to automate data collection, result parsing, and metric reporting
Document findings, track benchmark trends, and present results to the team
Work alongside engineers and researchers advancing autonomous technology

Requirements

What you’ll need

Currently enrolled in a B.S. or M.S. in Computer Science, Data Science, Engineering or a related field
Available to commit to a minimum three-month assignment
Able to commit to a minimum of 20 hours per week
Able to work on-site at one of our office locations
Must adhere with Zoox confidentiality requirements, including refraining from using or sharing proprietary company information outside of Zoox, such as in academic research, theses, publications, or presentations
Familiar with Cursor or Claude
Familiar with Python
Familiar with evaluation concepts: precision, recall, F1 score, and confusion matrices
Comfortable working with structured data (CSV, JSON)
Experience modifying or writing reproducible analysis scripts
Prior exposure to LLM-based systems, prompt engineering, or AI agent evaluation
Experience with Jira or Slack (e.g. ticketing systems, messaging apps)

Benefits

Comp & perks

Meaningful, ongoing work alongside academic studies
Opportunities to learn and develop new skills
Hands-on experience in a professional environment
Benefits eligibility determined by the vendor