Language Testing Specialist

The Center for Applied Linguistics is a nonprofit organization promoting access,equity and mutual understanding for linguistically and culturally diverse people around the world.

The mission of the Center for Applied Linguistics (CAL) is to promote language learning and cultural understanding by serving as a trusted source for research, resources, and policy analysis. Through its work, CAL seeks solutions to issues involving language and culture as they relate to access and equity in education and society around the globe.

CAL is located in Washington, D.C. For this position, the employee may choose to work in their preferred combination of in person at the D.C. office in a hoteling capacity, or remotely (up to 100% remote). CAL does not compensate or reimburse candidates for relocation expenses. This position is not open to candidates residing in New York, New Jersey, Pennsylvania, Texas, California, or the U.S. Territories.

The Language Testing Specialist plays a critical role in developing, reviewing, and revising test items for WIDA ACCESS and WIDA Screener, large-scale English language proficiency assessments for multilingual learners in grades 1-12.

This position involves development of test items (linguistic content, graphics descriptions, scripts) that align to the WIDA English Language Development Standards Framework; implementing stakeholder feedback on the items; conducting qualitative analyses of student responses to items; conducting internal reviews, proofing, and mock administrations of test materials; selecting training responses for use in scoring; and quality control checks of test items prior to delivery and live administration.

• Research and write test items aligned to item specifications and revise based on feedback from test development content managers
• Evaluate, review, and revise test materials and documents, including providing feedback to both external consultants and fellow team members on test item development
• Write and refine graphics descriptions to support student comprehension of test items
• Evaluate and track changes to graphics for content accuracy and grade-level appropriateness
• Prepare materials for internal and external reviews of test materials
• Coordinate item development tasks of external consultants (theme generators, item writers, standards experts, etc.) to ensure timely delivery of test items
• Incorporate item feedback from project managers, clients, and other subject matter experts (standards experts, bias/sensitivity & content reviewers, etc.) at multiple stages of development
• Analyze data from small scale pilot activities with new items; use teacher and student feedback to make revisions
• Analyze and interpret field test data to inform revisions to items or new item development
• Communicate and collaborate within and across teams throughout the test development process
• Adhere to quality control procedures for print and computer-delivered items
• Prepare and maintain files and records (summary reports, electronic notes, spreadsheets, etc.)
• Write and revise test item specifications
• Prepare training samples, annotations, and scoring notes for raters of speaking and writing responses

EDUCATION AND EXPERIENCE:

• A Bachelor’s degree from an accredited college or university, in a relevant field, with at least two years of relevant experience; OR
• A Master’s degree from an accredited college or university, in a relevant field.

The ideal candidate for this role has:

• Experience working with K-12 English learners (ELs) in U.S. school contexts, particularly in grades K-5.
• Experience teaching English to speakers of other languages (e.g., ESL, ESOL, ELD).
• Experience developing multiple choice and constructed response test items for K-12…