Technical Certification Program Sr. Advisor

Overview

Senior Certification Exam Development Specialist (Psychometrician)

One Identity is an award‑winning security software provider offering a broad selection of solutions that solve some of the most common and most challenging IT security problems. Part of the One Identity Software group, One Identity solutions eliminate the complexities and time‑consuming processes often required to govern identities, manage privileged accounts and control access. Our solutions enhance business agility while addressing IAM challenges within on‑premises, cloud and hybrid environments.

The combined entity delivers a complete portfolio of market‑leading Identity Access Management, Privileged Access Management, and Identity Governance solutions. Now, customers can achieve identity‑centric security with trusted, proven technology in each major category.

We are seeking a certification exam development specialist with strong psychometric expertise to establish and maintain standards for our certification and credentialling program. This includes design, validate, and maintenance of certification exams for one identity’s software solutions.

This role is responsible for translating product knowledge and instructional content into high‑quality assessments that accurately measure a learner’s understanding and ability to apply that knowledge. The focus is on creating exams that are rigorous, fair, and aligned to real‑world product use.

This individual will partner closely with Product and instructional subject matter experts to ensure that assessments effectively validate the intended learning outcomes.

• Assessment Design and Development – Design and build certification exams that measure knowledge and applied understanding. Translate product functionality and instructional content into structured, testable assessment items. Develop exam blueprints aligned to defined learning objectives and job‑relevant skills. Create and maintain item banks including multiple‑choice, scenario‑based, and case‑based questions. Maintain consistency in the credentialing program across products.
• Psychometric Quality and Rigor – Apply psychometric principles to ensure exams are valid, reliable, and fair. Define scoring models, passing thresholds, and exam structures. Conduct item analysis including difficulty, discrimination, and effectiveness of distractors. Continuously calibrate exams to address variability in perceived difficulty.
• Curriculum Alignment (Non‑Ownership Role) – Partner with Product and instructional SMEs to understand the intent and outcomes of training content. Ensure exams accurately reflect what learners are expected to know and apply. Identify and resolve gaps where exams are perceived as too easy, too difficult, or misaligned. Establish clear linkage between learning objectives, curriculum content, and exam coverage.
• Lab‑Based and Performance Assessment – Design and introduce hands‑on, lab‑based assessment components to validate real‑world application. Define scenarios, tasks, and scoring criteria for performance‑based testing. Collaborate with platform owners to integrate lab environments into certification exams. Ensure hands‑on assessments are measurable, repeatable, and scalable.
• Exam Lifecycle Management – Own the lifecycle of certification exams including creation, release, maintenance, and updates. Ensure exams remain current with product changes and evolving use cases. Manage versioning and periodic refresh of exam content.
• Data Analysis and Continuous Improvement – Analyze exam performance data including pass rates, item performance, and learner outcomes. Identify trends related to exam difficulty and effectiveness. Use data to refine exam quality, consistency, and alignment. Provide insights to improve overall certification credibility and effectiveness.

• 5–10+ years of experience in assessment design, certification exam development, or psychometrics.
• Strong understanding of psychometric principles including validity, reliability, and item analysis.
• Experience developing technical or software‑related certification exams.
• Proven ability to translate complex technical content into clear,…