Senior Product Manager, AI Experimentation Platform

CSC Generation

. Own the vision, roadmap, and prioritization for the agentic experimentation platform .

Posted 10/22/2026full-timeCottonwood Heights • Utah • United StatesSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in product management with a focus on AI-driven experimentation platforms, including A/B testing, statistical analysis, and collaboration across engineering and marketing teams to drive measurable business outcomes.

Highest-signal resume keywords

Product Management ExperienceA/B Testing and Experimentation ProgramsStatistical Experiment DesignAI and LLM IntegrationSQL and Data Analysis

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

A/B TestingExperiment DesignStatistical AnalysisAI WorkflowsPrompt DesignFeature FlaggingEvent TrackingSQLGA4BigQuery

Soft Skills

Excellent CommunicationInfluencing Stakeholders

Tools & Technologies

LookerGA4BigQuery

Industry Keywords

EcommerceDigital ProductsExperimentation Infrastructure

Tech Stack

Tools & technologies

BigQuerySQL

About the role

Key responsibilities & impact

Own the vision, roadmap, and prioritization for the agentic experimentation platform
Define AI-agent participation across hypothesis generation, variant creation, test setup and QA, live monitoring, and ship-or-rollback decisions
Establish statistical and business guardrails, anomaly checks, approval workflows, and automatic rollback
Build adaptive optimization using multi-armed and contextual bandits
Partner with engineering and data science on assignment, bucketing, feature flags, event tracking, metrics, and the GA4/BigQuery statistics engine
Define and instrument platform success metrics including test velocity, win rate, revenue impact, and result trustworthiness
Enable self-serve experimentation for merchandising, marketing, UX, and engineering teams
Create standards and playbooks for metric definitions, test design, and readouts
Collaborate with engineering, design, analytics, merchandising, and marketing to deliver the platform and promote testing

Requirements

What you’ll need

5+ years of product management experience, including ownership of a platform, data, or internal tooling product
Hands-on experience running or building A/B testing and experimentation programs at scale in ecommerce or other high-traffic digital products
Strong statistical grounding in experiment design: power and sample size calculation, significance, peeking, multiple comparisons, and guardrail metrics
Hands-on experience building with AI and LLMs, including agentic workflows, prompt design, tool integrations, and evaluating AI output quality
Working knowledge of experimentation infrastructure — feature flagging, randomization, event tracking, and warehouse-native metrics
Strong analytical skills with hands-on use of SQL, GA4, BigQuery, Looker, or similar tools
Demonstrated impact on conversion, revenue, or testing speed with measurable results
Excellent communication skills and ability to influence engineering, data, and business stakeholders
Valid LinkedIn profile URL required, or credible explanation and alternative evidence of professional background
Employment contingent on a background check, including verification of prior employment dates

Benefits

Comp & perks

Paid time off policies
401(k) match
Medical, dental, and vision insurance
Variety of supplemental insurance policies
Employee discounts across the portfolio of brands
Outdoor perks
Employee wellbeing support
Recognition and milestone celebrations