Lead Specialist, Measurement

This role aligns to industry level title of Lead Specialist, Applied AI Measurement & Learning Systems Measurement & Learning | School Assessment Role Overview

We are seeking a Lead Specialist, Measurement to support the design, validation, and continuous improvement of intelligent measurement systems and AI-assisted assessment and learning workflows.

This role sits within the Measurement & Learning team and operates at the intersection of Measurement, Content Development, Learning Science, Technology, and AI Science, with responsibility for helping ensure AI-assisted systems consistently produce high-quality, valid, scalable, and instructionally meaningful outputs across assessment and learning use cases.

The role primarily supports AI-assisted assessment item development workflows, while also contributing to adjacent applications including AI-generated practice items, learning materials aligned to standards, AI-powered learning and feedback experiences, instructional guidance systems, and emerging approaches to evidencing student skills and competencies.

This role also contributes to the advancement of next-generation assessment approaches, including innovative item types, AI-assisted measurement opportunities, and new ways of assessing reasoning, applied learning, and student competencies.

• Lead and support the design and continuous improvement of AI-assisted assessment item development workflows embedded within broader assessment and learning systems
• Translate SME and measurement intent into structured, reusable AI-assisted workflows and agentic frameworks that support scalable, consistent, and auditable content generation and enhancement
• Use AI-assisted tools and rapid prototyping approaches to explore, test, and iterate on emerging assessment, content, learning, and instructional workflow innovations
• Support assessment and learning content across Mathematics, English Language Arts, Science, Social Studies, K–12 grade levels, TEIs, oral and constructed-response interactions, translation and multilingual content, and alignment to academic content standards
• Support fact checking, grammar, style refinement, distractor rationale strengthening, and key validation
• Ensure AI-assisted outputs meet expectations for validity, accuracy, fairness, accessibility, and instructional appropriateness

• Lead and support validation approaches for AI-assisted learning and assessment applications beyond core assessment item development workflows including
• Generation and evaluation of academically similar items and learning opportunities for student practice
• AI-assisted learning materials aligned to standards, learning goals, and instructional intent
• Innovative item types and new ways of assessing student skills, competencies, reasoning, communication, and applied learning
• Support validation and quality approaches for content and interactions used within AI-assisted online learning guides, instructional supports, and learner-facing experiences
• Help ensure AI-assisted assessment, feedback, and learning supports work together in educationally meaningful and instructionally aligned ways
• Contribute to the advancement of emerging intelligent measurement and learning system capabilities across assessment and instructional contexts

• Design and oversee validation studies evaluating the quality, appropriateness, effectiveness, interpretability, and educational defensibility of AI-assisted systems, outputs, and workflows
• Define evaluation criteria in collaboration with psychometricians, learning scientists, and content leaders
• Establish processes for ongoing monitoring and continuous improvement
• Develop frameworks for ongoing monitoring, drift detection, and continuous improvement of AI-assisted systems over time
• Support research and validation frameworks grounded in human expertise, empirical evidence, transparency, and continuous improvement
• Support technical documentation and evidence generation related to the validity, quality, effectiveness, interpretability, and performance of AI-assisted systems and outputs