Director, Experimentation, Decision Science

MERGE

. Design comprehensive cross-channel experimentation roadmaps and learning agendas aligned with client business goals across web, app, and paid/owned media channels .

Posted 10/7/2026full-timeUnited StatesLead💰 $114,400 - $145,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Expertise in designing and executing cross-channel experimentation roadmaps, with a strong focus on A/B and multivariate testing methodologies. Proven ability to translate complex data insights into strategic recommendations while managing client relationships and collaborating with cross-functional teams.

Highest-signal resume keywords

A/B TestingMultivariate TestingAdobe TargetClient Relationship ManagementData-Driven Decision Making

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Experimentation DesignStatistical AnalysisKPI DevelopmentAudience SegmentationPersonalization Strategies

Soft Skills

Communication SkillsProblem-Solving SkillsAttention to DetailSelf-Starter Mindset

Tools & Technologies

Experimentation PlatformsAnalytics ToolsUX/UI Collaboration Tools

Industry Keywords

Digital MediaWeb ExperimentationPerformance MeasurementTesting MethodologiesClient Upselling

About the role

Key responsibilities & impact

Design comprehensive cross-channel experimentation roadmaps and learning agendas aligned with client business goals across web, app, and paid/owned media channels
Formulate data-driven hypotheses and define experiment feasibility, KPIs, target audiences, sample size, duration, and confidence intervals
Drive audience segmentation and personalization strategies across digital touchpoints
Oversee the experimentation workflow from ideation and targeting setup through variant build specifications and post-launch quality assurance
Collaborate with engineering, analytics, UX/UI, and media teams to validate tag implementation, audience integration, and parameter tracking
Translate multivariate, A/B, and personalization experiment results into executive-ready stories and strategic next steps
Communicate program value through performance measurement and insights
Assess client experimentation programs, benchmark maturity, and deliver capability-enhancement action plans
Advise clients on experimentation processes, governance, documentation, methodologies, frameworks, and test prioritization
Upskill client and internal agency teams on experimentation best practices, statistical literacy, and testing tools
Cross-pollinate winning experiment concepts across media formats, site sections, and client portfolios
Assist with RFPs, contract renewals, client upsells, and new strategic service opportunities
Work directly with clients as a trusted advisor across web, digital, and media channels to scale experimentation and personalization programs

Requirements

What you’ll need

Bachelor’s degree in Marketing, Business, Statistics, Psychology, Human Factors, or equivalent practical experience
5+ years of web, digital or media experimentation experience
Direct experience running A/B, multivariate, and personalization experimentation programs across web, mobile, or digital media platforms
Proven track record of managing external client relationships, presenting to key stakeholders, and navigating matrixed organizations
Demonstrated history of partnering closely with engineering, UX/UI, analytics, and product teams to execute technical projects
Ability to manage multiple client accounts and concurrent test roadmaps independently under tight deadlines
Hands-on experience with Adobe Target
Experience with other experimentation and personalization platforms, a plus
Ability to evaluate client testing maturity, build strategic roadmaps, and align testing initiatives with business goals
Exemplary written and verbal communication skills to translate complex data into concise, digestible, and executive-ready recommendations
Ability to form partnerships with various client-side and agency-side stakeholders
Self-starter mindset with strong problem-solving skills, high attention to detail, and desire to continuously learn and share industry trends
Travel up to 30%, depending on client needs
US work authorization without current or future visa sponsorship requirement

Benefits

Comp & perks

Medical insurance
Dental insurance
Vision insurance
Life insurance
401K
Lifestyle Spending Account
Employer Paid Life & Disability Insurance
Flexible Time off
Holidays
Other benefits and rewards