Evaluation Specialist - Language Testing

Background

Kent, Campa and Kate Incorporated (KCK) is a federal contracting company that provides professional services to Government Agencies. We are currently seeking candidates for an Evaluation Specialist - Language Testing position for an administrative and training program support contract at the National Foreign Affairs Training Center (NFATC), formerly the Foreign Service Institute (FSI).

The Evaluation Specialist is located in the Language Studies Directorate, Division of Language Testing and Assessment (LS/LTA). LS/LTA provides language‑proficiency testing services for the Department of State and other U.S. Government agencies and entities. Proficiency test scores may be used to reinforce eligibility for Foreign Service hiring, remove language probation, determine compliance with language‑designated positions, determine eligibility for crossing the senior threshold;

and for language‑incentive pay purposes.

• Three years’ experience in positions where analyzing language testing data was the primary duty (more than 50% of the time)
• Post baccalaureate degree with significant quantitative focus in fields such as language testing, second language acquisition, educational measurement, evaluation, psychometrics, and/or applied linguistics
• Experience designing and conducting research studies, e.g., validity and reliability studies of language proficiency tests;
• Experience using data analysis software applications (e.g., SPSS, Stata, R, WINSTEPS, FACETS, Tableau) that are used to create, organize, and analyze large data files
• Experience using data analysis concepts, principles, and practices to conduct data collection, reviews, and reporting of information gathered during an organizational study
• Experience designing and implementing quantitative and qualitative data collection instruments, including surveys, interviews, focus groups, observations and site visits, case studies, and document reviews
• Strong ability to work in a diverse, multicultural team environment on high priority initiatives;
• Strong critical and creative thinking and analytical skills.
• Strong written and oral communication skills
• High level of initiative and ability to work independently;

• Designs and conducts quantitative and qualitative data collection and analysis for validity and reliability studies of language proficiency tests;
• Advises on design of validity and reliability studies of language proficiency tests for quality assurance purposes;
• Produces reports of validity and reliability studies;
• Organizes and improves test data reporting and analysis to track rater reliability, in‑house testing trends, and vendor performance on outsourced tests;
• Interprets data and communicates technical information (e.g., reports, recommendations) to non‑technical and senior level audiences;
• Assesses the need to update test procedures and makes recommendations when appropriate;
• Advies on and drafts policies and guidelines related to quality assurance processes and procedures for language proficiency testing;
• Supports Language Testing Unit quality assurance initiatives and LS‑wide initiatives related to testing and assessment

Kent, Campa and Kate Incorporated (KCK) is an equal opportunity employer. KCK does not discriminate against employees and applicants on the basis of race, color, religion, sex, ancestry, national origin, gender, sexual orientation, marital status, age, disability, gender identity, results of genetic testing, veteran status, or any other status protected by federal, state, and local law.