Training Evaluation Systems Specialist

Join Atlas Air Worldwide. Move the World with Us!

At Atlas Air Worldwide, we're not just an airline, we're a global engine powering cargo, passenger, and leasing operations across more than 70 countries. As a leader in outsourced aviation logistics, we're built on a foundation of safety, service excellence, integrity, innovation, teamwork, and responsibility. With over 30 years of history, a modern all-Boeing fleet, and nearly 5,000 teammates collaborating across operations, technical, and corporate functions, we're driven by purpose.

If you're ready to grow, innovate, and help us deliver excellence every single day, you belong here.

The Training Evaluation Systems Specialist supports the design, testing, implementation, and maintenance of training evaluation forms and systems used across multiple training programs in compliance with Federal Aviation Administration (FAA) regulations and reporting requirements. This role supports the transition from Subpart N&O training programs to the Advanced Qualification Program (AQP) framework and assists in maintaining accurate evaluation processes, data reporting, and system functionality.

The Specialist collaborates with Subject Matter Experts (SMEs), Data Management Specialists, internal stakeholders, and external vendors to ensure training evaluation systems are compliant, reliable, and user-friendly for pilots, instructors, dispatchers, and crew schedulers. This position also provides troubleshooting support, helps resolve system issues, and supports continuous improvement of training evaluation processes and reporting capabilities.

• Build, code, configure, audit, and maintain electronic training evaluation forms across multiple courses, fleet types, and training delivery methods, including classroom, simulator, and instructor‑led training environments.
• Configure, monitor, and maintain system processes, expiration tracking, and evaluation workflows within the Airline Information Management System (AIMS), utilizing reporting and analytics tools such as Microsoft Power BI and Tableau.
• Execute testing, validation, and quality assurance reviews of evaluation forms prior to production release to ensure accuracy, functionality, compliance, and usability.
• Monitor active evaluation forms and troubleshoot issues related to system logic, scoring, user access, data capture, workflow functionality, and overall system performance.
• Serve as the primary support contact for instructors, evaluators, and training personnel regarding evaluation form functionality, workflows, and system‑related issues.
• Document system issues, conduct root cause analysis, and coordinate with external system vendors to implement corrective actions, fixes, and system enhancements.
• Coordinate evaluation form updates resulting from Federal Aviation Administration (FAA) regulatory changes, curriculum revisions, and Advanced Qualification Program (AQP) modifications.
• Ensure all evaluation forms, workflows, and related processes comply with Federal Aviation Administration (FAA) regulations, company policies, and required data collection and reporting standards.
• Maintain version control, configuration records, audit documentation, testing results, and release documentation for all evaluation form updates and system changes.
• Collaborate with Advanced Qualification Program (AQP), Training and Standards, Training Records, and Information Technology (IT) stakeholders to align evaluation tools and reporting processes with operational and regulatory requirements.
• Support audits, Federal Aviation Administration (FAA) data requests, and internal compliance reviews by providing documentation related to evaluation logic, system controls, testing, and reporting accuracy.
• Participate in system upgrades, new course implementations, reporting enhancements, and technology improvement initiatives related to training evaluation systems.
• Performs additional duties as assigned by the Senior Manager, AQP.

• Minimum Bachelor's degree in Aviation, Information Systems, Data Analytics, Training and Development, Instructional Design, Business Administration, or a related field…