Assessment Measurement Specialist

Job Description

The Assessment Measurement Specialist is an applied psychometrician who provides measurement expertise in support of K12's assessment programs and assessment-related initiatives. This role conducts technical analyses of assessment quality and performance, evaluates the relationships and comparability among interim, growth, and state assessments, and provides technical recommendations that inform assessment selection, renewal, and use. The Educational Psychometrician supports SPM/CAMP by reviewing assessment results for unusual patterns, conducting targeted technical reviews of flagged results, and identifying data or methodological limitations that affect how results should be interpreted.

This role develops technical documentation and guidance to support consistent, appropriate interpretation of assessment results across the organization, and partners closely with Assessment, Accountability, Academics, Research, and Data teams to translate technical findings for nontechnical audiences.

Essential Functions

• Provide psychometric expertise for K12 assessment programs and assessment-related initiatives.

• Review and compare interim and growth assessment options, including vendor technical documentation, norms, scoring methodologies, growth measures, research evidence, and administration requirements; evaluate fit for intended use and provide technical recommendations to support assessment selection and renewal decisions.

• Support SPM/CAMP by reviewing interim assessment results and identifying unusual score changes, subgroup patterns, conflicting assessment evidence, or other results warranting deeper technical review.

• Conduct targeted assessment reviews of flagged School Progress Meeting (SPM)/ Continuous Accountability Monitoring Plan (CAMP) results to determine whether observed patterns reflect meaningful performance differences, expected measurement variation, administration issues, data-quality concerns, or limitations of the assessment.

• Evaluate the reliability and validity of assessment results and measures, including score distributions, reliability, measurement error, subgroup patterns, and other indicators of assessment quality and performance.

• Identify limitations in assessment data or methodology that could affect conclusions and provide clear guidance regarding appropriate interpretation and use.

• Evaluate cross-assessment comparability and provide recommendations regarding when results from different assessments can appropriately be compared or used together to triangulate academic performance.

• Develop technical documentation, guidance, and resources to support consistent and appropriate interpretation of assessment results across the organization.

• Analyze relationships between interim and state assessments to determine how well interim results correspond with state proficiency and growth outcomes.

• Analyze student assessment growth results and apply established methodologies to evaluate the interpretation and use of vendor and state growth measures

• Partner with Assessment, Accountability, Academics, Research, and Data teams on assessment-specific questions and communicate technical findings clearly to nontechnical audiences.

• Monitor developments in educational measurement, assessment validity and reliability, and general K-12 assessment practices and recommend appropriate applications to K12's existing assessment practices.

• Perform other duties as assigned.

Minimum Required Qualifications

• Master's degree in Psychometrics, Educational Measurement, Quantitative Psychology, Applied/Educational Statistics, Research Methods, or a related field, or equivalent combination of education and experience.

• 8 or more years of experience in psychometrics, educational measurement, or assessment-related analytic work, including experience with K12 assessment programs.

• Demonstrated expertise applying psychometric methods such as reliability analysis, measurement error, score distribution analysis, and subgroup performance analysis.

• Experience analyzing and interpreting growth measures (e.g., student growth percentiles, value-added, or vendor-specific growth models) and evaluating their appropriate use.

• Experience reviewing vendor technical documentation (technical manuals, norms, scoring methodologies, reliability/validity evidence) to inform assessment selection or renewal decisions.

• Strong written and verbal communication skills, with demonstrated ability to translate complex technical/statistical findings for nontechnical audiences.

• Demonstrated ability to work independently and exercise sound technical judgment on ambiguous or sensitive data-quality questions.

Desired Qualifications

• Ph.D. in Psychometrics, Educational Measurement, Quantitative Psychology, Applied Statistics, or a related field.

• Experience supporting a school performance/accountability model (e.g., SPM/CAMP-type frameworks) or similar state or organizational accountability system.

• Familiarity with major K12 interim and formative assessment vendors and their…