Senior AI Engineer, MapGPT

Mapbox

. Define product behavior, measurement frameworks, and evaluation systems for non-deterministic behavior .

Posted 11/2/2026full-timeRemote • United StatesSenior💰 $175,100 - $236,900 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and optimizing data pipelines, evaluating non-deterministic systems, and mentoring engineering teams. Proficient in Python or TypeScript, with a strong understanding of production ownership and on-call responsibilities.

Highest-signal resume keywords

Data Engineering DepthStrong Python SkillsExperience With Data PipelinesProduction Ownership Of ServicesDirect Experience With Evaluations

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

SQLDistributed Processing FrameworkData Pipeline DevelopmentModel EvaluationLatency DiagnosisAPI DesignSDK DevelopmentAgent OrchestrationGeospatial Data ExperienceVoice Pipeline Experience

Soft Skills

Comfort With AmbiguityJudgment To Ship SolutionsMentoring Engineers

Tools & Technologies

MCPCLI ToolsStreaming ASRTTSOpenStreetMap

Certifications & Qualifications

Bachelor's Degree In STEM

Industry Keywords

Non-Deterministic SystemsOn-Call RotationError BudgetsAutomotiveIn-Vehicle Infotainment

Tech Stack

Tools & technologies

AndroidPythonSQLTypeScript

About the role

Key responsibilities & impact

Define product behavior, measurement frameworks, and evaluation systems for non-deterministic behavior
Formulate hypotheses, define correct results, assemble datasets, and gate changes on regression results
Continuously evaluate APIs, SDKs, data representations, and reference applications from end-user perspectives
Identify misuse, integration anti-patterns, and gaps, recommend fixes, and ensure fixes are implemented
Own the MVP against an agreed north star technical design
Balance technical perfection with shipping useful increments
Build data pipelines and tooling for ingestion, conflation, entity resolution, quality checks, and batch and streaming jobs
Track and evaluate external datasets, models, and benchmarks from research and open-source releases
Decide when to adopt existing solutions versus building internally
Design feedback loops and instrument systems to provide reproducible failure context
Convert recurring failures into evaluation cases
Design model-tool boundaries and improve model harnesses
Determine model responsibilities, delegation, and state management
Optimize latency and cost per request through streaming, partial results, caching, model routing, and prompt structure
Build internal CLI, MCP, and other tools for rapid iteration
Share reusable tools with other teams
Conduct code and design reviews
Mentor engineers on evaluation practices
Help answer unresolved technical questions
Participate in a 24/7 on-call rotation to maintain system availability

Requirements

What you’ll need

Bachelor's Degree in a STEM discipline
5+ years of software engineering experience
Production ownership of services, pipelines, or SDKs
2+ years shipping LLM-backed features to real users
Experience with systems carrying error budgets, on-call rotations, and customer-visible regressions
Data engineering depth including SQL and at least one distributed processing framework
Experience with data pipelines where incorrect records mattered more than slow processing
Fluency with tool calling and agent orchestration, including stale context, hallucinated arguments, silent partial success, and unbounded loops
Strong Python or TypeScript skills
Comfort reading code in other programming languages
Direct experience or deep understanding of evaluations for non-deterministic systems
Experience building datasets and identifying failures through evaluation
Working knowledge of more than one agent harness
Experience diagnosing latency in a distributed request path
Comfort with ambiguity and judgment to ship narrow, working solutions
Participation in an on-call rotation, including potential immediate response outside normal working hours and weekends
Geospatial data experience, routing, geocoding, POI or address data, OpenStreetMap, or conflation of overlapping sources (nice to have)
Public API or SDK design experience (nice to have)
Experience building against MCP or similar tool transports (nice to have)
Experience running evaluations in CI (nice to have)
Automotive, in-vehicle infotainment, CarPlay, or Android Auto experience (nice to have)
Voice pipeline experience including streaming ASR, TTS, barge-in, endpointing, or wake word (nice to have)
Experience working under constrained compute, offline, or intermittent connectivity (nice to have)
Experience operating a product through its first external integrations (nice to have)

Benefits

Comp & perks

Supportive health care
Parental leave
Flexible work arrangements
Teaching and learning opportunities
Private medical coverage for you and your dependents
Generous maternity and paternity leave policies
Inclusive fertility support
Lifestyle Spending Account contributions for health, wellness, and personal growth
Mental health support for you and your dependents
Flexible paid time away
Company holidays
Generous absence policies
Dedicated paid volunteering time
Retirement plans with competitive matching
Hybrid/remote work options