Test & Evaluation AI SME

Overview

Systems Planning and Analysis, Inc. (SPA) delivers high-impact, technical solutions to complex national security issues. With over 50 years of business expertise and consistent growth, we are known for continuous innovation for our government customers, in both the US and abroad. Our exceptionally talented team is highly collaborative in spirit and practice, producing Results that Matter. Come work with the best!

We offer opportunity, unique challenges, and clear-sighted commitment to the mission. SPA:
Objective. Responsive. Trusted.  The Joint, Office of the Secretary of Defense, Interagency Division (JOID) provides expert support services to a range of customers spanning across the Department of Defense, Federal Civilian, and international markets. JOID provides a diverse portfolio of analytical and programmatic capabilities to help our customers make informed decisions on their most challenging issues.

The Critical Infrastructure Group (CIG) within JOID provides technical, programmatic and analytical support to customers with missions in national security to include the Department of Homeland Security (DHS), Health and Human Services (HHS), and the Federal Aviation Administration (FAA). The Group brings technical and operational expertise in fields of countering weapons of mass destruction, critical infrastructure protection, emergency response, nuclear non-proliferation, weapons deployment programs, and transportation safety.

In addition to management and advisory services, CIG staff collaborate closely with our clients to provide high-quality modeling, simulation, software, and analytical products to meet the most demanding government standards and timelines. We have a near-term need for a Testing and Evaluation Artificial Intelligence SME to provide hybrid support for DHS customers located in Washington, DC.

Responsibilities

The T&E Analyst will review and comment on revisions of program T&E documents and provide the Government advice. Support multiple DHS acquisition programs, especially in capabilities that involve AI. Provide AI T&E expertise to assist the Government with ensuring that DHS acquisition programs generate suitable, executable T&E approaches that adequately assess the effectiveness, suitability, reliability, robustness, security, explainability, and operational risks of AI technologies embedded in technical solutions.

Provide support, guidance, recommendations, and mentoring to all Deputy Directors regarding AI T&E and the development of DHS standards for evaluating embedded AI technologies, including reviews of program TEMPs, Operational Assessment/Test Plans, Operational Assessment/Test Reports, and Letters of Assessment. Provide support to the instructional advisor regarding the inclusion of AI T&E within the T&E curriculum. Provide, as directed, focused training on AI T&E.

Research Government and industry acquisition and T&E sources and analyze results for applicable AI evaluation standards, tools, metrics, plans, and procedures.

Qualifications

Required:

Advanced Degree or equivalent credits/certifications.
10+ years of relevant experience.

Active Secret clearance .Demonstrated skills and abilities to develop and implement strategies, standards, and methods to integrate AI T&E activities—including, but not limited to, data quality and representativeness assessments, AI performance and robustness testing, bias assessments, human-AI interaction evaluations, adversarial testing, and post-deployment monitoring—in support of acquisition programs, including, but not limited to, aviation, detection equipment, cybersecurity, information technology, decision-support systems, and autonomous systems.

Desired:

DHS T&E Level 3 equivalent certification.

Pay Range…