Senior Director, Assessment

PA Education Association

. Lead the strategy, planning, implementation, evaluation, and continuous improvement of current and future assessment products and services .

Posted 11/5/2026full-timeRemote • United StatesSenior💰 $147,000 - $158,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in psychometrics and educational measurement, with a strong focus on assessment product development, strategic planning, and leadership in managing assessment initiatives. Proven ability to communicate complex technical concepts effectively to diverse audiences while ensuring compliance and quality in assessment practices.

Highest-signal resume keywords

Doctoral Degree In PsychometricsClassical Test TheoryItem Response TheoryStrategic PlanningProject Management

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Educational MeasurementAssessment DevelopmentValidationScoringEquatingStandard SettingPsychometric AnalysisData AnalysisAssessment ReportingContinuous Improvement

Soft Skills

LeadershipCommunicationProblem-SolvingDecision-MakingCollaboration

Tools & Technologies

RData Visualization ToolsAssessment PlatformsAnalytical Technologies

Industry Keywords

Health Professions EducationAssessment SecurityComplianceStakeholder ManagementProfessional Measurement Organizations

About the role

Key responsibilities & impact

Lead the strategy, planning, implementation, evaluation, and continuous improvement of current and future assessment products and services
Align assessment priorities with organizational goals and member needs
Monitor developments in educational measurement, psychometrics, assessment technology, artificial intelligence, and health professions education
Collaborate with organizational leaders on assessment initiatives, business planning, and product development
Oversee the full assessment lifecycle, including blueprint development, item banking, test construction, administration, scoring, scaling, equating, standard setting, reporting, quality assurance, and technical documentation
Ensure assessments are valid, reliable, fair, accessible, secure, legally defensible, and compliant with standards and policies
Lead psychometric analyses and measurement research
Guide development and use of data tools, analytical solutions, and measurement technologies
Communicate technical findings, score interpretation guidance, and assessment information to technical and nontechnical audiences
Supervise, coach, and mentor Assessment staff; manage performance and foster cross-functional alignment
Support staff development, professional participation, knowledge sharing, cross-training, and succession planning
Oversee exam development, production schedules, budgets, resource allocation, volunteer engagement, and vendor performance
Coordinate assessment staff, subject matter experts, vendors, and external partners
Implement process improvements that enhance quality, efficiency, scalability, sustainability, and stakeholder experience
Represent PAEA through presentations, publications, workshops, consultation, and professional service
Strengthen members’ assessment literacy through educational programming, consultation, score interpretation resources, and dissemination of best practices
Protect the confidentiality, integrity, and security of assessment materials, data, and processes
Coordinate incident response, risk mitigation, and compliance activities

Requirements

What you’ll need

Doctoral degree (PhD, EdD, or equivalent) in Psychometrics, Educational Measurement, Quantitative Psychology, Educational Psychology, Statistics, Research Methodology, or a closely related field
Minimum of 8 years of progressively responsible experience in assessment, psychometrics, educational measurement, testing, or related fields
Minimum of 3 years of supervisory or leadership experience managing professional staff and complex projects
Deep knowledge of Classical Test Theory, Item Response Theory, Rasch measurement, standard setting, test development, validation, scoring, equating, and assessment reporting
Demonstrated experience leading assessment programs, initiatives, or portfolios
Experience managing external vendors, consultants, and stakeholder relationships
Strong strategic planning, organizational leadership, and project management skills
Excellent written and verbal communication skills, including the ability to explain technical concepts to non-technical audiences
Ability to manage multiple priorities and lead complex cross-functional initiatives
Strong analytical, problem-solving, and decision-making skills
Demonstrated commitment to assessment quality, fairness, accessibility, and continuous improvement
Must be authorized to work in the United States
Experience in health professions education and assessment preferred
Experience developing innovative assessment products, technologies, or services preferred
Record of professional presentations, publications, or contributions to the assessment and measurement field preferred
Experience managing assessment security programs and policies preferred
Experience with R, data visualization tools, assessment platforms, and modern analytical technologies preferred
Active involvement in professional measurement or testing organizations preferred
Must be able to perform essential duties satisfactorily with reasonable accommodation

Benefits

Comp & perks

Health insurance
Life insurance
Disability insurance
Paid time off
Paid holidays
403(b) retirement plan with an 8% employer contribution
Monthly wellness stipend
Professional development funding
Tuition assistance
Periodic travel to all-staff meetings, PAEA events, professional development opportunities, and other necessary meetings