FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and operating production systems utilizing LLM APIs, with a strong focus on model observability, error categorization, and performance evaluation. Capable of navigating the complexities of AI models and ensuring effective collaboration across teams to drive improvements.
Highest-signal resume keywords
AI FluencyProduction Systems DevelopmentLLM API IntegrationModel ObservabilityError Categorization
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Production SystemsLLM APIsError CategorizationModel EvaluationLatency ReasoningCost TradeoffsOutput Quality TradeoffsSelf-Healing RetriesCross-Provider FailoverToken Economics
Soft Skills
CollaborationProblem SolvingAdaptability
Industry Keywords
AI ModelsInference ReliabilityObservabilityStreamingContext LimitsProduction Failure Modes
About the role
Key responsibilities & impact- Bring new frontier models into production quickly
- Make inference reliable through improved error categorization, self-healing retries, and cross-provider failover
- Own observability for the model layer and reduce time to detection and resolution
- Build model-level capabilities and help product teams adopt them
- Coordinate across Notion’s AI teams, identify gaps, unblock people, and ensure fixes reach the appropriate owner
Requirements
What you’ll need- Comfort with a rapidly changing frontier-model landscape
- AI fluency as a practitioner
- Experience building and operating production systems on top of LLM APIs
- Understanding of token economics, streaming, tool calling, context limits, and production failure modes
- Ability to define evaluations and measure model or prompt improvements
- Ability to reason about latency, cost, and output-quality tradeoffs
- Ability to work from a Notion office on Mondays, Tuesdays, and Thursdays (Anchor Days)
Benefits
Comp & perks- Highly competitive cash compensation
- Equity
- Benefits
- Reasonable accommodations during the application process
