Test Development Coordinator

Position Overview

Accessible Teaching, Learning, and Assessment Systems (ATLAS), a research center at the University of Kansas (KU), is seeking an English Language Arts Test Development Coordinator on our Test Development Team. The Test Development Coordinator will support and guide the production of operational, standards-based assessments by participating in test development efforts from initial item authoring through all stages of item refinement, review and field testing to final operational test forms construction.

The Test Development Coordinator will primarily focus on ensuring that ELA assessment items support valid interpretations of test scores, adhere to industry best practices, and appropriately elicit observable evidence of targeted cognition as described by curricular standards for both general populations and for students with the most significant cognitive disabilities.

Successful applicants will demonstrate deep and thorough expertise with the Next Generation ELA Standards and will be familiar with a range of either classroom approaches and/or standardized assessment approaches to collecting evidence of student mastery of curricular standards. ATLAS applies principles of Evidence Centered Design (ECD) to its test design and development processes. Therefore, expertise and the ability to provide thought leadership to other members of the ELA team with regard to these principles in an assessment context is a plus.

ATLAS promotes learning and improved outcomes for all students, with a focus on students with disabilities and struggling learners. ATLAS creates technology-based learning and assessment systems that are accessible and academically rigorous. Dynamic research on skill development, assessment design, and teacher professional development informs the center's map-based learning systems.

With a diverse portfolio of grant-funded research projects and operational alternate assessments, ATLAS is a leader in educational research and innovation. ATLAS drives progress through partnerships and collaborations with organizations that share its focus and commitment.

ATLAS is committed to creating policies and practices that foster a culture in which all employees feel they belong and can succeed.

KU is not able to provide immigration sponsorship for this position.

Due to complex state employment laws, the University of Kansas may be unable to hire fully remote workers for this position outside of Kansas. Specifically, we cannot currently offer employment to candidates residing in the following states:
California, Delaware, Idaho, and Minnesota. We appreciate your understanding and invite interested individuals from eligible states to apply.

55% - Ensure expectations for validity, fairness, and quality assurance for items are met. Activities may include:

• Reviewing and refining items written by external item writers in accordance with established standards of quality and internally and externally imposed deadlines.
• Contributing to the development of task models and construct definitions based in Evidence Centered Design principles, and guiding the ELA team to apply the task models consistently when reviewing items.
• Helping to resolve external, expert feedback on test items and test forms.
• Contributing to the design of trainings and orientations for item writers, internal staff, and external reviewers.
• Contributing to the identification, analysis, and improvement of existing processes and documentation to improve content validity.

35% - Coordinate and organize test development efforts, processes, and documentation. Activities may include:

• Collaborating on test and item designs for innovative ELA assessments.
• Coordinating workflow for ELA content at multiple stages of the test development process.
• Contributing to the management of the test item pool.
• Assembling and/or reviewing field test and operational test forms to meet blueprint, test design, and psychometric criteria.
• Contributing to the identification, analysis, and improvement of existing processes and documentation to improve efficiency or meet best practice standards.
• Preparing, reviewing, and editing test blueprints, performance level descriptors, responses to RFPs, and technical reports.
• Collaborating with the psychometric and technology teams to create ancillary testing materials, such as interpretive guides, score reports, and website documents.

5% - Contribute subject matter expertise to grant-funded projects led by Lead Researchers and Principal Investigators.

5% - Special projects/other duties as assigned.