Test and Assessment Specialist Job Virginia Beach area,Virginia USA,Quality Assurance

Valkyrie Enterprises is seeking a qualified Test and Evaluation Specialist to support the Navy Afloat Maintenance Training Strategy (NAMTS) program. The preferred candidate will have experience developing, validating, and evaluating Navy technical training assessments, with emphasis on performance-based qualification in maintenance, repair, troubleshooting, and equipment operations.
The specialist will develop and evaluate written examinations, practical assessments, and qualification evaluation instruments to measure technical knowledge and demonstrated job proficiency. The position requires the ability to distinguish between knowledge-based requirements and hands-on technical competencies, ensuring assessment methods accurately measure a candidate's ability to perform maintenance tasks safely and in accordance with established technical standards.
Located in Virginia Beach, VA.

Job Description:

Analyze technical tasks, qualification requirements, and learning objectives to identify appropriate assessment methods and measurable performance criteria.
Develop, review, and validate written examinations, technical skills assessments, practical performance evaluations, structured oral boards, and standardized evaluation checklists.
Design criterion-referenced assessments and scoring rubrics that measure achievement of established technical knowledge and performance standards.
Develop technically accurate multiple-choice questions, scenario-based assessments, and practical evaluation instruments aligned with approved technical references and qualification requirements.
Establish observable performance indicators, critical task steps, safety requirements, acceptable tolerances, and completion criteria for hands-on technical assessments.
Evaluate existing examination items for technical accuracy, clarity, answer-key validity, distractor effectiveness, and alignment with authoritative references.
Apply established test development principles to support assessment validity, reliability, fairness, and consistent application across participating maintenance activities.
Establish and maintain traceability between examination items, technical tasks, learning objectives, qualification requirements, and supporting references.
Collaborate with Navy subject matter experts (SMEs) and instructional designers to determine appropriate assessment methods based on task complexity, criticality, safety, equipment availability, and operational requirements.
Analyze examination results, performance assessment outcomes, item-analysis metrics, and qualification trends to identify deficiencies in technical knowledge, demonstrated skills, or assessment design.
Conduct performance gap and root-cause analyses to distinguish training deficiencies from other factors, including inadequate practical experience, unclear procedures, or ineffective assessment instruments.
Recommend corrective actions, including examination revisions, assessment improvements, curriculum modifications, and changes to qualification requirements.
Support periodic JQR and examination reviews to ensure assessment products remain technically accurate, current, and aligned with Fleet maintenance requirements.
Maintain examination documentation, revision histories, assessment records, and configuration-controlled products to support quality assurance and program integrity.

Qualifications:

Must have Bachelor's degree in Instructional Design, Education, Training and Development, Engineering, a technical discipline, or a related field and at least 4 years of directly relevant technical training, test development, or performance assessment experience;
or Associate's degree and at least 8 years of directly relevant Navy technical training, assessment development, curriculum development, or qualification development experience;
or High school diploma/equivalent and at least 10 years of directly relevant Navy technical training, maintenance, assessment development, or qualification development experience.
Must have demonstrated experience developing, reviewing, or validating technical examinations, practical skills assessments, qualification standards, JQRs, PQS, or comparable Navy technical training and assessment products.
Must have working knowledge of Instructional Systems Development (ISD), task analysis, learning-objective development, criterion-referenced testing, and performance-based assessment methodologies.
Must have the ability to translate technical maintenance tasks, procedures, and…