Senior Data Scientist, Agentic UX

Sitetracker

. Own day-to-day decisions and solution definition for an experience area .

Posted 10/15/2026full-timeRemote • United StatesSenior💰 $145,000 - $215,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and analyzing A/B tests, building AI evaluation systems, and developing agentic user experiences. Proficient in statistical and machine learning applications, production code shipping, and collaborating across teams to drive product success.

Highest-signal resume keywords

Statistical And Machine Learning FluencyA/B Test Design And AnalysisAgentic UX And Behavior DesignAI Behavior And Platform ArchitectureCustomer Engagement And Usage Analysis

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Production Code ShippingData Pipeline DevelopmentEvaluation Harness CreationContext Architecture DesignDecision Path DefinitionCommunication Pattern DesignUsability ReviewBehavior AnalysisRoot Cause IdentificationMetrics Establishment

Soft Skills

MentoringCollaborationPresentation SkillsFeedback Provision

Tools & Technologies

AI-Assisted Development ToolsClaude CodeCursorScoutDashboards

Industry Keywords

TelecommunicationsEV ChargingRenewablesUtilitiesCustomer WorkflowsMarket TrendsCompetitive Landscape

About the role

Key responsibilities & impact

Own day-to-day decisions and solution definition for an experience area
Define leading indicators, scope work, prioritize effectively, and make tradeoff decisions across user needs, agent behavior, technical constraints, and business goals
Monitor competitive landscapes, market trends, adjacent products, and emerging AI tools
Develop expertise in telecommunications, EV charging, renewables, utilities, and related customer workflows
Investigate complex cross-team problems using logs, traces, evaluations, and customer behavior
Instrument unmeasured areas, design analyses, identify root causes, and move findings to action
Work directly with customers, run pilots, analyze usage, and turn behavioral patterns into design decisions
Design end-to-end agentic experiences, including context architecture, decision paths, communication patterns, and behavioral contracts
Design for web and mobile experiences and agents across field and enterprise users
Ship production code, build AI graphs, prototypes, data pipelines, instrumentation, and evaluation harnesses
Architect Scout graphs and define decision paths, context architecture, communication patterns, and product surfaces
Create comprehensive evaluations covering correctness, grounding, safety, refusal, latency, and tone
Design offline and online evaluation strategies and build supporting datasets
Design and run A/B tests, holdouts, and shadow evaluations
Run usability and behavior reviews, customer betas, and previews
Establish metrics tied to commercial outcomes and track adoption and success
Build dashboards and analyses to make adoption and outcomes visible
Review others' evaluations, experiments, analyses, and agent designs; mentor and provide actionable feedback
Potentially manage a dedicated intern
Collaborate with product management, design, engineering, and scrum-team peers

Requirements

What you’ll need

Statistical and machine learning fluency applied to production behavior
Ability to design and analyze A/B tests, holdouts, and shadow runs
Ability to build offline and online LLM evaluation systems
Experience with agentic UX and behavior design, including context architecture, decision paths, and communication patterns
Ability to work directly with customers through pilots, usage analysis, betas, and previews
Ability to open pull requests, ship production code, build prototypes, data pipelines, instrumentation, and reusable evaluation harnesses
Fluency in platform architecture, retrieval, grounding, graph logic, and AI behavior
Ability to architect Scout graphs and sophisticated AI interactions
Competitive and market awareness across multiple verticals
Deep product knowledge and understanding of industry-specific workflows
Ability to present to senior stakeholders and translate complex technical and quantitative concepts
Ability to demo the product and cross-product functionality
Experience or ability to use AI-assisted development tools such as Claude Code, Cursor, and Scout
Ability to work within an existing codebase and engage in technical discussions with engineering
No explicit educational credential or minimum years of experience stated