Manager of Testing & Psychometrics

Manager of Testing & Psychometrics

Aspen Publishing is seeking a Manager of Testing & Psychometrics to be a part of our growing company. You will work in partnership with many departments, as well as external stakeholders including law school deans and directors, to deliver on the mission of the JD-Next team. We are looking for a Manager of Testing & Psychometrics who is passionate about testing and assessments and wants to positively impact students' first step on their legal education journey.

Reports To:

Director, JD-Next

Department: JD-Next

Location:

Burlington, MA (will consider remote for the right candidate)

Range: $110.6 (MIN)/$155.25 (MID)/$199.9 (MAX)

Position Summary:

Responsible for developing innovative systems for high-stakes adaptive educational assessments within the successful family of JD-Next products, including an online course and high-stake law school entrance exam delivered multiple times per year. Conduct psychometric and statistical analyses in support of product development and operations with the goal of ensuring the validity and fairness of the use of test scores provided to clients.

Essential Duties And Responsibilities:

• Oversee complex projects in a fast-paced environment
• Help ensure test security and excellence for both high-stakes and low-stakes testing environments; this includes ensuring that JD-Next has sufficient new content to maintain test security, validity, and fairness
• Perform psychometric evaluations and processes as necessary
• Oversee and maintain accountability for test results data management, analysis, and score reporting.
• Lead evaluation of the test design and test blueprints, determining when changes are warranted, in collaboration with the assessment team; provide psychometric consultation on form assembly to ensure exams meet psychometric and validity standards.
• Manage annual ABA Standard 509 Reporting, ensuring compliance with ABA requirements and preparing internal and external reports based on the data.
• Communicate JD-Next value and process with admissions office deans and directors and other key stakeholders
• Clearly communicate technical issues to internal and external stakeholders
• Enhance operational procedures and document best practices
• Ensure quality control processes for project deliverables
• Engage in a research program, contribute to publications, and present virtually and at conferences
• Support and mentor staff for professional development
• Collect and store data on sales numbers, market research, logistics, linguistics, or other behaviors as necessary; bring technical expertise to ensure the quality and accuracy of that data
• Perform analysis to assess the quality and meaning of data for JD-Next and, as necessary, for Aspen; utilize psychometric models and process, design, and communicate data in ways to help stakeholders, internal and external, interpret the data and make better decisions.
• Use automated tools to extract data from primary and secondary sources
• Develop and maintain databases, and data systems – reorganizing data in a readable format
• Travel as required for the role
• Perform other duties as assigned

Qualifications:

• Master's or Ph.D. in Educational Measurement, Psychometrics, Industrial Organization or Psychology or a related field with psychometric or statistical expertise preferred
• 7+ years work experience in the testing industry preferred
• Knowledge of law school admissions and/or legal education a plus
• Record of leading complex projects in large-scale assessment
• Experience working directly with external clients including educational institutions and programs
• Demonstrated leadership in overseeing technical experts in large-scale psychometrics and statistics
• Proficiency in software packages for conducting psychometric and statistical analytical work and research (e.g., R, Python)
• Proficiency in communicating technical research and psychometric and statistical concepts to non-technical audiences and analyze applied measurement problems and purpose solutions
• Experience with Agile methods and collaborative problem-solving
• Collaborative mindset with a talent for providing innovative solutions
• Excellent interpersonal skills, including effective teamwork and communication skills
• Excellent written, verbal, and presentation skills
• Excellent with Microsoft Office (PowerPoint, Outlook, Excel, Word) and statistical tools
• Proven ability to manage multiple projects under strict deadlines
• Ability to analyze issues and provide solutions
• Customer service mindset
• Liaise between internal and external groups
• Manage multiple vendors
• Troubleshoot and problem solve
• Willing to travel as needed
• Work with individuals at all levels of the organization
• Ability to work quickly and accurately in a fast paced, changing environment
• Ability to meet deadlines in a consistent and accurate manner
• Demonstrated ability in working independently and as part of a team

Physical Requirements:

• Normal office environment
• Ability to sit for extended periods of time
• Ability to work on computer for extended periods of time
• Ability to…