Evaluation Manager

POSITION OBJECTIVE

The evaluation manager takes leadership in designing, developing, and implementing ongoing evaluation of medical education programs, curricula, faculty teaching, and medical student achievement in a learner-centered curriculum. This role is responsible for oversight of evaluation tool development, data collection, management, analysis, and visualization related to medical education. The evaluation manager provides expertise and support in designing, developing, and implementing evaluations for all projects overseen by the Office of Medical Education Research and Evaluation (MERE).

The evaluation manager will work collaboratively in a fast-paced multi-disciplinary environment with faculty and students in a variety of areas, including but not limited to Curricular Affairs, Student Affairs, educational research and evaluation across the School of Medicine, and medical education programs in the Office of Medical Education.

Responsibilities of the evaluation manager focus on the evaluation of the undergraduate medical education efforts, and other programs as prioritized by the Office of Medical Education, with attention to program quality and effectiveness, including courses, clerkships, faculty teaching, and data collection, management, analysis, and visualization. This role coordinates the design, development, and implementation of the evaluation program, including tools and dashboards with limited supervision.

In addition, this position is responsible for providing support for key initiatives across MERE’s portfolio and the Office of Medical Education as requested by the Associate Dean of Accreditation, CQI, and Academic Analytics, and Vice Dean for Medical Education.

• Design and manage ongoing program evaluation and quality improvement efforts with specific attention to the careful administration of a high volume of time-sensitive instruments, analyzing results, preparing reports, datasets, and visualizations. Manage, monitor, and update all data collection procedures, including conducting advanced quantitative and qualitative data collection, managing databases and all data collection relevant to medical education research and evaluation initiatives.
  
  Develop and present summary evaluation data for necessary committees. Analyze program evaluation data and compare current and prior classes as part of the overall evaluation of the program. Lead reporting of data trends. Present reports to committees and councils as requested. (20%)
• Direct efforts related to the evaluation of the MD program(s) in collaboration with the Director of MERE. Work collaboratively with educational leaders and other faculty to develop and implement program evaluation projects. Collaborate with faculty and staff in designing, assessing, updating, and revising evaluation procedures in compliance with AAMC recommendations and LCME requirements. (20%)
• Lead program evaluation analysis efforts, including but not limited to exporting, maintaining, creating and managing data and data visualizations. Maintain and improve a robust program evaluation tracking and management database which combines recent and historical data from various sources. Manage communication and collaboration with the School of Medicine and University technology teams to develop and maintain dashboards using Tableau, PowerBI, and other tools.
  
  Document and distribute materials for process improvement, data management, and automation within the designated groups. Act as the primary point of contact for process data inquiries, management, and visualization related to program evaluation. (20%)
• Primary responsibility of evaluation operations within the learning management system. This includes ensuring evaluation activities are implemented with accuracy and timeliness from programming and piloting evaluation tools to aggregation and dissemination of evaluation results to required stakeholders. Responsible for addressing student and concerns related to evaluation (within and outside of the learning management system) as they arise. (15%)
• Execute with minimal supervision other program evaluation activities and assume tasks and…