Program Manager - Evaluation

Position Summary

The Program Manager, Evaluation manages a portfolio of evaluation studies that aim to understand the impact of programs and services on patient health outcomes and disparities and use that information to improve services. The Program Manager, Evaluation designs and manages evaluations including development of key evaluation questions, data collection, and analysis plans as well as dissemination of evaluation results to staff and stakeholders, including, as required, local and national funders.

The position manages multiple projects and works with the Programs and Services team to support an equity lens and framework for ACCESS.

• Facilitate relationships between evaluation and program staff and across departments to design, implement,interpretanddisseminateevaluation activities as appropriate.
• Collaborate with program leadership todeterminekey evaluation questions relevant to grant projects and ACCESS evaluation needs.
• Design and manage the execution of credible andfeasibleevaluations that address identified purposes and questions. This includes:
  • Program conceptualization: development of theory of change, logic models, workflows, and benchmarks.
  • Formative and summative evaluation:
    
    Identify quality improvement opportunities and develop recommendations to strengthen program services and organizational operations.
  • Negotiate and manage timelines and document evaluation processes and products
• Develop and implement processes for data collection and analysis:
  • Develop qualitative and quantitative data collection tools for evaluation, including, but not limited to, interview guides, focus group guides, surveys, etc.
  • Ensure data quality andparticipatein data integrity review
  • Conduct review of literature to justify appropriate methodsto answer evaluation questions andidentifyassumptions that underlie methodologies and program logic.
  • Monitor andmaintainsystems for effective participant and data flow for studies, including working with subcontractors to set up data collection and transfer systems and process data as required.
• Prepare evaluation communication documents for program improvement and dissemination throughout project, including quarterly updates and annual reports.
• Collaborate with project team and leadership to draft abstracts and scientific papers for presentation & publication.
• Ensure that all documents associated with current local, state, & federal regulatory guidelines, requirements, laws &researchor evaluation protocols are complete din a timely manner.
• Performs other duties as assigned.

• Bachelor’s degree in Public Health, Health Administration, Social Sciences, or a related field, with advanced graduate-level coursework supporting evaluation and research initiatives.
• Developed and conducted program evaluations, research studies, and study coordination activities to assess outcomes and inform strategic decision-making.
• Applied public health and evaluation frameworks, including RE-AIM, CFIR, developmental evaluation, action learning/research, and other pragmatic evaluation approaches.
• Designed and implemented qualitative research methods, including focus groups, key informant interviews, and stakeholder feedback processes.
• Utilized qualitative data analysis software, including NVivo and Atlas.ti, to analyze findings and identify actionable insights.
• Led quantitative research efforts, including survey development, deployment, data collection, and analysis to evaluate program effectiveness and outcomes.
• Selected, analyzed, and interpreted descriptive and parametric statistics to support evaluation findings and evidence-based recommendations.
• Conducted human subjects research in compliance with HIPAA requirements, research protocols, and information-sharing standards.
• Leveraged advanced Microsoft Excel and Word skills, along with REDCap and other data collection and database platforms, to manage data and reporting activities.
• Utilized electronic health record systems, including Epic, to support data analysis, program evaluation, reporting, and quality improvement initiatives.