Principal Data Scientist

Zillow

. Define and operationalize measurement strategy for the Connections Platform and broader Data & Infrastructure Platform .

Posted 11/5/2026full-timeRemote • United StatesLead💰 $182,100 - $290,900 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in defining and operationalizing measurement strategies for complex platforms, with a strong focus on quantifying impact and outcomes through advanced evaluation methods. Proficient in translating complex data findings for executive stakeholders and establishing rigorous metrics and KPIs.

Highest-signal resume keywords

Data ScienceA/B TestingCausal Inference MethodologyPythonSQL

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Measurement StrategyMetrics DefinitionKPI DevelopmentEvent Taxonomy DesignQuasi-Experimental MethodsInterrupted Time-SeriesDifference-In-DifferenceSynthetic ControlLLM-Based Systems EvaluationPlatform-as-a-Product

Soft Skills

Stakeholder CommunicationCollaboration with Engineering Teams

Certifications & Qualifications

PhD in Quantitative FieldMS in Quantitative FieldBS in Quantitative Field

Industry Keywords

Data & Infrastructure PlatformUser-Facing SystemsAI Impact MeasurementProductivity OutcomesRevenue Effects

Tech Stack

Tools & technologies

PythonSQL

About the role

Key responsibilities & impact

Define and operationalize measurement strategy for the Connections Platform and broader Data & Infrastructure Platform
Quantify platform impact, outcomes, and business/revenue effects for executive decision-making
Define meaningful metrics, KPIs, dashboards, leading indicators, and lagging indicators
Build rigorous, repeatable evaluations for LLM-based and agentic systems, including LLM-as-a-judge and Braintrust tooling
Design and analyze A/B tests and quasi-experimental causal inference studies
Apply switchbacks, difference-in-difference, synthetic control, and interrupted time-series methods
Establish evaluation feedback loops separating activity and adoption from genuine quality and outcomes
Partner with engineers to instrument events, schemas, pipelines, metrics, and dashboards
Translate complex measurement findings and trade-offs for VP and C-level stakeholders
Set measurement standards for platform teams and support Platform-as-a-Product measurement
Assess multi-dimensional product changes affecting consumers, partners, developers, business, and revenue

Requirements

What you’ll need

10+ years in Data Science, UX Research, or Applied Science
Meaningful experience measuring products where the customer is a developer, internal team, or platform
Experience designing evaluations for complex user-facing systems, including LLM-as-a-judge and human review
Production experience with A/B testing and causal inference methodology
Experience designing primary metrics, KPIs, OKR metric definitions, and leading/lagging indicator systems
Ability to design event taxonomies, schemas, and instrumentation with engineering teams
Proficiency in Python and SQL
Ability to translate measurement narratives for VP and C-level partners
PhD and 4+ years, MS and 6+ years, or BS and 8+ years of experience in a quantitative field (listed under preferred qualifications)
Direct experience measuring complex production systems, including conversational, LLM-based, or agentic products
Experience with modern evaluation methods and offline/online evaluation harnesses
Experience measuring AI or agentic tooling impact on productivity, quality, outcomes, and ROI
Experience with Platform-as-a-Product models
Fluency with quasi-experimental and causal inference methods, including difference-in-difference, synthetic control, interrupted time-series, and switchback/interleaved designs

Benefits

Comp & perks

Equity awards based on experience, performance, and location
Remote work from a physical location of choice
Flexible work from wherever employees are most productive through Cloud HQ
Professional growth and development opportunities
Inclusive and innovative workplace culture