Lead Specialist, Measurement

Lead Specialist, Measurement

This role aligns to industry level title of Lead Specialist, Applied AI Measurement & Learning Systems

Measurement & Learning | School Assessment

We are seeking a Lead Specialist, Measurement to support the design, validation, and continuous improvement of intelligent measurement systems and AI-assisted assessment and learning workflows.

This role sits within the Measurement & Learning team and operates at the intersection of Measurement, Content Development, Learning Science, Technology, and AI Science, with responsibility for helping ensure AI-assisted systems consistently produce high-quality, valid, scalable, and instructionally meaningful outputs across assessment and learning use cases.

The role primarily supports AI-assisted assessment item development workflows, while also contributing to adjacent applications including AI-generated practice items, learning materials aligned to standards, AI-powered learning and feedback experiences, instructional guidance systems, and emerging approaches to evidencing student skills and competencies.

This role also contributes to the advancement of next-generation assessment approaches, including innovative item types, AI-assisted measurement opportunities, and new ways of assessing reasoning, applied learning, and student competencies.

• Lead and support the design and continuous improvement of AI‑assisted assessment item development workflows embedded within broader assessment and learning systems
• Translate SME and measurement intent into structured, reusable AI‑assisted workflows and agentic frameworks that support scalable, consistent, and auditable content generation and enhancement
• Use AI‑assisted tools and rapid prototyping approaches to explore, test, and iterate on emerging assessment, content, learning, and instructional workflow innovations
• Support assessment and learning content across Mathematics, English Language Arts, Science, Social Studies, K–12 grade levels, TEIs, oral and constructed‑response interactions, translation and multilingual content, and alignment to academic content standards
• Support fact checking, grammar, style refinement, distractor rationale strengthening, and key validation
• Ensure AI‑assisted outputs meet expectations for validity, accuracy, fairness, accessibility, and instructional appropriateness

• Lead and support validation approaches for AI‑assisted learning and assessment applications beyond core assessment item development workflows including
• Generation and evaluation of academically similar items and learning opportunities for student practice
• AI‑assisted learning materials aligned to standards, learning goals, and instructional intent
• Innovative item types and new ways of assessing student skills, competencies, reasoning, communication, and applied learning
• Support validation and quality approaches for content and interactions used within AI‑assisted online learning guides, instructional supports, and learner‑facing experiences
• Help ensure AI‑assisted assessment, feedback, and learning supports work together in educationally meaningful and instructionally aligned ways
• Contribute to the advancement of emerging intelligent measurement and learning system capabilities across assessment and instructional contexts

• Design and oversee validation studies evaluating the quality, appropriateness, effectiveness, interpretability, and educational defensibility of AI‑assisted systems, outputs, and workflows
• Define evaluation criteria in collaboration with psychometricians, learning scientists, and content leaders
• Establish processes for ongoing monitoring and continuous improvement
• Develop frameworks for ongoing monitoring, drift detection, and continuous improvement of AI‑assisted systems over time
• Support research and validation frameworks grounded in human expertise, empirical evidence, transparency, and continuous improvement
• Support technical documentation and evidence generation related to the validity, quality, effectiveness, interpretability, and performance of…