Evaluation Specialists

Work Arrangement

Remote (7am-4:00pm M-F)

3500 Pennsy Dr, Landover, MD 20785 (Mandatory onsite training with occasional on-site meetings at Carmen Turner Facility in Landover, Maryland or other Metro facilities.)

Either Web Cam or In Person

1 Year initial Contract with a possible extra 2 Years extension on yearly basis

Applications with resumes in PDF Format will be automatically rejected. Only Word format resumes will be considered.

• Design Evaluation Strategies:
  Develop comprehensive evaluation plans and tools to measure the effectiveness, efficiency, and impact of training programs.
• Develop and Deploy Data Collection Tools:
  Create and utilize surveys, rubrics, focus groups,observational protocols, interviews, etc. that are methodologically sound to gather data from learners, facilitators, SMEs, and stakeholders.
• Translate Complex Data Into Actionable Insights:
  Through compelling data storytelling,visualizations, and narrative summaries tailored to diverse audiences.
• Build and Maintain Interactive Dashboards and Executive Level Reporting Tools:
  Use platforms such as Power BI or similar to support real-time decision making.
• Analyze and Interpret Evaluation Data:
  Apply statistical and thematic analysis techniques to identify trends, strengths, and areas for improvement in training delivery and outcomes.
• Support Continuous Improvement:
  Collaborate with instructional designers and training teams torefine content and delivery methods based on evaluation insights and learner feedback.

• Bachelors degree in education, psychology, or related field
• 3+ years of experience in training evaluation
• Experience with technical training programs, with a preference for transit
• Demonstrated expertise in data storytelling and the ability to craft clear, engaging narratives from complex data sets
• Proficiency with advanced data tools and platforms, including but not limited to:
• Power BI or other analytics platforms for dashboard creation
• Data collection tools (Microsoft Forms, Surveymonkey, or similar)
• Strong command of Excel, but with a mindset that goes beyond spreadsheets seeking automation, integration, and visualization opportunities
• Excellent communication skills, with the ability to present findings to both technical and nontechnical stakeholders
• Familiarity with Kirkpatrick Model, Philips ROI Model, Learning-Transfer Evaluation Model and other evaluation models to measure the impact of training
• Proficiency in survey platforms and data analysis tools and methods

• Experience with SPSS, R, or Python for statistical analysis
• Familiarity with other learning evaluation models like Philips ROI Model, Learning-Transfer Evaluation Model, and TPACK or SAMR