Senior Software Engineer – AI / ML

. Make frontier AI data generation and evaluation faster, cheaper, and more rigorous with ML and AI .

Posted 9/26/2026full-timeSan Francisco • California • United StatesSenior💰 $208,000 - $315,000 per yearWebsite

Tools & technologies

Python

Key responsibilities & impact

Make frontier AI data generation and evaluation faster, cheaper, and more rigorous with ML and AI
Study how frontier-grade data is generated and evaluated
Form hypotheses and validate them against real production data
Ship successful approaches at scale
Cut the cost of long-horizon agent evaluation using adaptive sampling, statistically grounded early stopping, model cascades, caching, and cheap-first gating
Route evaluation and judge calls to the cheapest model that clears the quality bar, with fallback, monitoring, and cost attribution
Fine-tune and serve open-weight models using LoRA and other parameter-efficient methods
Build models that estimate task difficulty for frontier systems before rollout
Build golden datasets and quantify LLM-as-judge accuracy and calibration
Turn research prototypes into reusable, configurable components for deployed engineers and researchers
Help shape ML engineering standards, discipline direction, and the growing team

What you’ll need

5+ years building production ML or software systems, with end-to-end ownership from prototype to production
Hands-on experience running LLM or ML workloads in production
Comfort reasoning about non-deterministic systems
Deep grounding in statistics and experimentation, including experiment design, hypothesis testing, sampling, and confidence intervals
Strong Python and software engineering fundamentals, including testing, code review, and system design
Experience designing evaluations and interpreting results rigorously
Habit of finding high-impact problems before they are assigned
Clear communication with researchers, engineers, and business partners

Comp & perks

Meaningful opportunities to shape priorities and initiatives
Influence key strategic decisions
Directly impact Snorkel AI’s ongoing success
Opportunities to deepen technical expertise
Leadership opportunities
Opportunities to learn new skills across multiple functions
Support for career building in an environment designed for growth, learning, and shared success
Reasonable accommodation for individuals with disabilities during application/interview processes, job performance, and receipt of employment benefits and privileges