Manager, Assessment Development & Innovation

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Salary Full-Time Management Lake Mary, FL, US

Location: Lake Mary, FL (Hybrid)
Department: Global Certifications
Status: Full-Time | Exempt

The Institute of Internal Auditors (IIA) is the global leader and recognized authority for the internal audit profession. We advance the profession worldwide through education, advocacy, certifications, and professional resources. Guided by our values of People First, Integrity, Collaboration, Accountability, and Innovation, we offer a collaborative, purpose-driven workplace where employees can grow professionally while making a global impact.

• Make a global impact by helping ensure professional certification exams remain rigorous, relevant, and trusted.
• Help shape the future of assessment through innovative testing methods and emerging technologies.
• Collaborate with subject matter experts, volunteer committees, and teams across a global professional organization.
• Explore new approaches to assessment, including AI-assisted item generation and scoring.
• Grow your career in a collaborative, values-driven organization committed to innovation and continuous improvement.

The Institute of Internal Auditors (IIA) is seeking a
Manager, Assessment Development & Innovation to support and advance our certification exam programs through rigorous, standards-aligned test development practices.

This role plays a central part in job task analysis (JTA), content development, item review, and standard-setting activities that help ensure certification exams remain valid, defensible, and reflective of current practice in the field.

The Manager will also lead independent initiatives exploring new assessment methods, innovative content development, and emerging technologies—including AI-assisted item generation and scoring—to strengthen and modernize The IIA's portfolio of certification programs.

Success in this position requires strong project management skills, sound psychometric judgment, analytical capabilities, and the ability to effectively facilitate and collaborate with subject matter experts (SMEs), volunteer committees, external stakeholders, and cross-functional internal teams.

This is a
hybrid position based in Lake Mary, Florida
.

• Facilitate SME and stakeholder sessions throughout the exam development lifecycle, including JTA data-gathering sessions, item review panels, and standard-setting sessions using Modified Angoff or comparable methodologies.
• Develop interview protocols and conduct focus groups to support JTA data collection.
• Design and implement JTA surveys to gather practitioner input at scale.
• Develop PowerPoint presentations, pre-meeting materials, and other resources that support SME understanding of JTA, item curation and review, and standard-setting activities.
• Prepare and organize data for standard-setting activities, including item-level statistics and rating materials.
• Manage end-to-end SME item curation, including assignment, tracking, and quality control.
• Evaluate AI-generated exam items for accuracy, relevance, quality, and alignment with content specifications.
• Analyze survey and standard-setting data to validate task and knowledge statements, inform syllabus development, and confirm consistency and defensibility.
• Develop clear, accurate reports summarizing JTA methodology, findings, and recommendations for internal and external stakeholders.
• Write standard-setting reports suitable for accreditation and legal defensibility, including alignment with ISO/IEC 17024 and applicable Uniform Guidelines.
• Lead new assessment initiatives with…