Senior Efficacy Research and Psychometrics Analyst

Khan Academy Türkçe

. Lead the technical side of psychometrics and efficacy research for Khan Academy Kids assessments and learning content .

Posted 9/25/2026contractRemote • California • United States, CanadaSenior💰 $137,871 - $155,105 per yearWebsite

Tech Stack

Tools & technologies

PythonSQL

About the role

Key responsibilities & impact

Lead the technical side of psychometrics and efficacy research for Khan Academy Kids assessments and learning content
Serve as the primary technical point of contact for external psychometric research partners
Support study design, data sharing, psychometric analyses, and interpretation of findings
Extract, clean, and securely share assessment data with research partners on a recurring schedule
Analyze item difficulty, score distributions, growth analyses, concurrent validity, and IRT-based scoring
Translate research findings into product improvements, including scoring models and assessment discontinuation rules
Develop and publish technical documentation, beginning with the technical manual for the PreK assessment
Recruit and onboard school and district sites for psychometric and efficacy studies
Execute MOUs, align on consent procedures and participant incentives, and coordinate site visits for direct child assessment data collection
Partner with legal to draft and negotiate data-sharing agreements
Coordinate Khan Academy Kids’ participation in ongoing efficacy studies and contribute to future study design
Build and maintain the Khan Academy Kids KPI dashboard with engineering, including App Store Connect and Google Play Console integrations
Prepare monthly and quarterly business reviews, periodic target setting, and recurring app performance reporting
Handle ad hoc SQL data requests for targeted district outreach and grant reporting
Collaborate with product managers, engineers, designers, academic experts, and external research organizations

Requirements

What you’ll need

An advanced degree (PhD or Master's) in psychometrics, educational measurement, quantitative methods or a related field — or equivalent applied experience
Strong grounding in psychometric methods, including item analysis, reliability and validity evidence, growth modeling, and Item Response Theory (IRT)
Proficiency with SQL and a statistical programming language (e.g., R or Python) for extracting, cleaning, analyzing, and visualizing data
Experience with (or eagerness to learn) business intelligence tools such as Looker, and comfort building dashboards and data pipelines
Familiarity with responsible data-sharing practices in education research, including student data privacy considerations (e.g., FERPA, COPPA) and work with pseudonymized and deidentified data
Excellent communication skills: able to translate complex psychometric findings into clear implications for product teams, funders, and school partners
Strong project-management and organizational skills, with the ability to coordinate multiple external partners, recurring deliverables, and data-sharing schedules with close attention to detail
Proven cross-cultural competency skills, demonstrating self-awareness, awareness of others, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization
Motivated by Khan Academy’s mission “to provide a free, world-class education for anyone, anywhere”
Experience with (or strong interest in) early childhood education and assessment of young learners is a plus

Benefits

Comp & perks

Competitive salaries
Ample paid time off as needed – Your well-being is a priority
8 pre-scheduled Wellness Days in 2026 occurring on a Monday or a Friday for a 3-day weekend boost
Remote-first culture - that caters to your time zone, with open flexibility as needed, at times
Generous parental leave
An exceptional team that trusts you and gives you the freedom to do your best
The chance to put your talents towards a deeply meaningful mission and the opportunity to work on high-impact products that are already defining the future of education
Opportunities to connect through affinity, ally, and social groups
401(k) + 4% matching
Comprehensive insurance, including medical, dental, vision, and life