Principal Psychometrician

Job Summary

The Principal Psychometrician is responsible for leading psychometric strategy and solution design for large‑scale assessment programs, with a primary focus on supporting state procurements and advancing innovative, defensible measurement approaches. This role includes designing psychometric frameworks aligned to federal peer review requirements, advising on operational and research models, and collaborating across teams to ensure technically sound and scalable assessment solutions.

The role requires deep expertise in IRT and large‑scale operational psychometrics, strong knowledge of the assessment landscape, and the ability to translate complex technical concepts into practical, client‑centered solutions. This individual must be both technically rigorous and strategically minded, with the ability to anticipate state needs and design creative, defensible approaches to meet them.

• Lead psychometric solution design for state procurements, including technical approaches for scaling, equating, reporting, and standard setting
• Develop and articulate defensible psychometric methodologies aligned to federal assessment peer review requirements
• Design and evaluate IRT‑based models, including calibration, equating, scaling, and linking approaches across assessment programs
• Advise on operational psychometric processes, including field testing, item calibration, form assembly, and quality control procedures
• Lead strategic engagement with Technical Advisory Committees (TACs) and expert groups to inform, validate, and advance innovative assessment solutions, while guiding clients toward aligned, defensible approaches
• Partner with content, product, psychometric, implementation, and operational teams to ensure psychometric considerations are integrated across the assessment lifecycle
• Support development of technical documentation for proposals, including technical reports, validity evidence, and methodological justifications
• Lead cross‑functional solution design across School Assessment, partnering with measurement and learning, new ventures, partner success, technology, and product teams to develop innovative, scalable solutions and ensure effective transition from design to execution
• Identify innovative and practical approaches to meet evolving state and federal assessment needs
• Conduct or guide research studies to support validity, reliability, fairness, and comparability of assessment systems
• Translate complex psychometric concepts into clear, actionable guidance for internal teams and external stakeholders
• Provide technical leadership and mentorship to psychometric and cross‑functional teams

• 8+ years of experience in large‑scale educational assessment, including operational psychometrics
• Advanced degree (PhD preferred) in Psychometrics, Statistics, Measurement, or a related field
• Deep expertise in Item Response Theory (IRT) and its application in large‑scale assessments
• Experience designing and implementing psychometric models for statewide or large‑scale assessment programs
• Strong understanding of federal assessment requirements, including peer review expectations
• Experience supporting or leading technical components of state RFP responses or procurements
• Demonstrated experience with calibration, equating, scaling, and standard setting methodologies
• Strong analytical and problem‑solving skills, with the ability to apply theory to operational contexts
• Experience developing technical documentation and communicating results to diverse audiences

• Strategic mindset with the ability to anticipate client needs and design forward‑looking solutions
• Strong collaboration skills and ability to work across content, product, and operational teams
• Ability to balance technical rigor with practical implementation constraints
• Excellent written and verbal communication skills, including the ability to explain complex concepts clearly
• High level of organization and ability to manage multiple priorities in a fast‑paced environment
• Curiosity and commitment to staying current with advancements in psychometrics and assessment design

The minimum full‑time…