AI Automation Engineer – Real-World Test Lab

Niantic Spatial, Inc.

. Own end-to-end automation for Lab evaluations, including environment setup, run orchestration, artifact capture, and result collection .

Posted 9/29/2026full-timeSan Francisco • California • United StatesMid-LevelSenior💰 $158,400 - $210,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in end-to-end automation for lab evaluations, including environment setup, orchestration, and artifact capture. Proficient in Python and capable of producing actionable diagnostics while collaborating effectively with cross-functional teams.

Highest-signal resume keywords

Production-Grade AutomationPython ProgrammingCI-Style PipelinesBackend Services EvaluationTechnical Writing

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AutomationTest InfrastructureEnvironment SetupRun OrchestrationArtifact CaptureResult CollectionWorkflow AutomationData DiagnosticsQuality EvaluationLatency Thresholds

Soft Skills

CollaborationClear Communication

Tools & Technologies

Cloud StorageAPIsReproducible Environments

Certifications & Qualifications

Bachelor's Degree

Industry Keywords

Lab EvaluationsAutomation WorkflowsPriority Customer Use CasesVersion Comparisons

Tech Stack

Tools & technologies

CloudPython

About the role

Key responsibilities & impact

Own end-to-end automation for Lab evaluations, including environment setup, run orchestration, artifact capture, and result collection
Instrument scorecards to compare results across product versions, devices, and capture conditions
Build agent workflows that exercise priority customer use cases at realistic scale across varying difficulty levels
Convert one-off experiments into standing protocols that run on every relevant release
Automate recurring inspection and route tasks requiring human judgment to scalable human review
Produce actionable diagnostics with reproducible cases and attached data
Collaborate with the AI Data Manager to ensure runs are reproducible from known dataset states
Report to the Director of the Real-World Test Lab
Deliver one fully automated priority workflow within 30 days
Enable automatic evaluation triggers and failure routing within 60 days
Place three priority workflows under standing automated evaluation with version comparisons within 90 days

Requirements

What you’ll need

Built and maintained production-grade automation or test infrastructure relied on daily by other engineers
Experience evaluating systems where correctness is graded by quality, accuracy, or latency thresholds rather than pass/fail assertions
Strong Python skills
Fluency in orchestration, CI-style pipelines, cloud storage, and reproducible environments
Experience working with backend services and APIs not owned by the candidate
Ability to write technical findings clearly enough for non-authors to act without a meeting
A bachelor's degree in a relevant field, or equivalent experience
Ability to work in the San Francisco office three days per week
Work authorization without restrictions in the country where the position is based

Benefits

Comp & perks

Annual bonus
Equity
Comprehensive benefits package
Medical coverage
Dental coverage
Vision coverage
401(k)