Interim Vice-President, Psychometrics and Data Analytics

The Pharmacy Examining Board of Canada (PEBC), a national not-for-profit certification and assessment body for the pharmacy profession, is seeking an Interim Vice-President, Psychometrics and Data Analytics.

This is a highly strategic executive mandate. PEBC is looking for a strong, proven leader who can redefine its psychometric and data strategies and provide senior leadership across psychometrics, enterprise data strategy, analytics, governance and business intelligence.

Reporting to the Chief Executive Officer and serving on the Senior Management Team, the Interim Vice-President holds overall accountability for psychometrics and related data analysis, and leads PEBC’s enterprise data strategy, data analytics and business intelligence, data governance, and reporting. The role ensures the validity, reliability, fairness and defensibility of high-stakes national certification examinations, and positions data as a strategic asset informing decision-making across the organization.

Combining strategic leadership with deep technical authority, the Interim Vice-President advances psychometric and analytic practice through established and emerging methodologies, research and evidence-informed decision-making.

• Oversee the psychometric quality of all assessments, validity, reliability, fairness and defensibility, through test design and administration support, standard setting, equating, scaling, scoring and results reporting.
• Ensure consistent application of psychometric methodologies across assessments, in line with professional standards and best practices.
• Direct statistical and forensic analyses of examination outcomes, candidate performance and testing incidents (including remote proctoring) to support fair, evidence-based decisions.
• Lead the initial development and implementation of an enterprise data governance framework, data quality, integrity, security, privacy, retention, definitions and stewardship, alongside metadata management, a data catalogue, and master and reference data management.
• Govern analytical and AI/machine-learning models used in or affecting assessments, including model validation, bias and fairness testing, performance monitoring, drift detection and documentation.
• Own the reporting, dashboard and data-visualization environment, including self-serve business intelligence for senior leadership, the Board and stakeholders, underpinned by a governed single source of truth and semantic layer.
• Champion a data strategy that treats assessment and operational data as a strategic asset, and advance analytics from descriptive and diagnostic reporting toward predictive and prescriptive capability.
• Steward the multi-year data strategy and analytics roadmap aligned to the strategic plan, in collaboration with technology leadership, which owns the underlying data platform and engineering.
• Chair the data governance operating model, with named data owners and stewards in each function, reporting through the Senior Management Team to the CEO.
• Advise on psychometric and standard-setting decisions with high-stakes or policy-level impact, and on statistical and forensic findings related to testing irregularities.
• Partner closely with executive peers in Assessments, Technology and Operations, and present psychometric results, validity evidence and recommendations to the Board's examinations committee.
• Lead all HR matters for the Psychometrics and Data Analytics department, including recruitment, training, retention and performance management, along with annual business priorities, projects and budget.

• PhD required, ideally in psychometrics or educational measurement, or in a closely related quantitative discipline such as statistics.
• Significant progressive…