Director of Educational Assessment

Location:

Chicago, Illinois
Business Unit:
Rush Medical Center
Hospital:
Rush University Medical Center
Department: UME - Curriculum-Assessment
Work Type:
Full Time (Total FTE between 0.9 and 1.0)

Shift: Shift 1

Work Schedule:

8 Hr (7:00:00 AM - 3:00:00 PM)
Pay Range: $43.10 - $64.22 per hour

The Director of Educational Assessment ensures that Rush Medical College meets its mission and program objectives through the development, implementation, and continuous improvement of a comprehensive, learner-centered assessment strategy. This strategy includes formative, summative, and narrative assessment; knowledge and behavior-based assessment; regular quantitative and qualitative feedback; and individualized learner enrichment and support.

The Director provides strategic and operational leadership for educational assessment across all phases of undergraduate medical education (pre-clerkship and clerkship), ensuring alignment between course-, program-, and institutional outcomes. The role promotes a culture of master adaptive learning among students, faculty, and administrators and serves as a senior institutional expert in assessment design, implementation, analysis, and policy.

• Advanced degree, PhD or MD equivalent
• 2 - 5 years of management experience
• Significant experience in educational assessment, program evaluation, or medical education
• Demonstrated technical expertise in:
  • Assessment blueprinting
  • Written, simulation, and workplace-based assessment
  • Behavioral assessment design and evaluation
  • Standard setting methodologies
  • Proven people leadership and management experience
  • Strong analytical, communication, and stakeholder engagement skills

• Advanced training or certification in assessment, medical education, or psychometrics
• Experience working with NBME, AAMC, or comparable national assessment bodies
• Experience overseeing complex academic or clinical education operations

• Design and implement an integrated, learner-centered assessment strategy across all four years of medical school
• Ensure alignment of assessment practices with program objectives, institutional mission, accreditation standards, and strategic priorities
• Balance knowledge-based and behavioral assessments based on curricular goals, learner progression, and available resources
• Promote ethical, equitable, and defensible assessment practices across programs and courses

• Translate desired learner outcomes into measurable performance indicators (e.g., session objectives, course objectives, program objectives, milestones, entrustable professional activities)
• Develop and oversee assessment blueprints at the program, course, and individual learner levels
• Provide expert guidance on written assessments, simulation-based assessments, workplace-based assessments, grading rubrics, and standard setting
• Build frameworks and tools to support course directors and faculty in assessment design and implementation
• Align internal performance measures with external benchmarks, including USMLE, NBME examinations, and national survey data

• Develop equitable thresholds for learner progression, enrichment, and remediation
• Create strategies to identify struggling and off-track learners and assess both short and long-term outcomes of remediation efforts
• Collaborate with Medical Student Affairs and Student Accessibility Services to ensure appropriate support and accommodations
• Assess long-term outcomes of the curriculum, including predictive indicators of student success

• Analyze and interpret assessment data at the learner, course, and program levels
• Analyze external assessment and evaluation data (e.g., NBME, AAMC)
• Communicate assessment findings to stakeholders through reports, dashboards, and presentations tailored to audience needs
• Use assessment data to inform curricular improvement and institutional decision-making

• Develop and deliver faculty development programs on best practices in assessment
• Collaborate with faculty and leadership to publish and present innovations in medical education assessment
• Foster a culture of self-regulated and self-directed learning among learners and faculty

• Lead and manage the day-to-day operations of the educational assessment enterprise
• Oversee assessment calendars, logistics, policies, procedures, scoring processes, and data maintenance
• Prepare, manage, and oversee budgets related to assessment operations
• Identify, evaluate, and manage external assessment vendors and contracts in collaboration with institutional purchasing teams
• Coordinate assessment activities with the Rush Clinical Skills and Simulation Center

• Provide direct supervision, mentorship, and professional development for assessment staff, including managers, coordinators, contractors, and student workers
• Oversee…