Applied AI Manager-Evaluation & Measurement

** Job *
* The Leonardo DRS Airborne and Intelligence Systems business is a global leader and strategic partner committed to delivering world-class, full life-cycle defense and intelligence products that protect the security of our nation and our allies.  From air combat training to state-of-the-art electronic warfare systems, our technology is deployed by virtually all U.S. military and government agencies around the world.

** Job Summary*
* We've used AI before, now we treat it as a first-class citizen at Airborne & Intelligence Systems (AIS). We build and deploy AI across signals intelligence, electronic warfare, air combat training, and the mission systems that connect them. This work shows up on our floor, in the field, and on the company's P&L, while meeting the demanding standards of our defense and commercial customers.

If you want your work and your talent to count - this is the place.

Two questions follow every AI system we build: does it actually work, reliably, on real jobs and is it actually worth the money we say it is? You own both answers. You design the test every capability must pass before it can ship, and you build the measurement that turns results into honest numbers leadership can trust. You hold the line.

Nothing ships until it clears your bar - no test, no launch - and you're deliberately independent from the person who builds and deploys, so the check is real. When there's pressure to over-claim a result, you're the one who holds the number honest.

At the heart of this function is a proprietary platform, the encoded way this business does AI. It takes any employee from a rough idea to a governed, well-formed use case, checks it against the rules, and prepares a recommendation a human decision-maker rules on. You don't just use it; you also build it. The quality bar and measurement logic you design get embedded into the platform itself, so the standard travels with the system to every team that touches it.

You encode the acceptance standard and the value math once, and every team inherits both.

This is a high impact, founding individual-contributor seat within the technical core of AI Excellence function with meaningful end to end work ownership. You report directly to top leadership of the function giving you outsize visibility, opportunity for personal growth and direct line to impact. Your peers will be AI leads for Solutions & Delivery/ Infrastructure & Deployment

** Job Responsibilities*
* + Define "good enough to ship." Design the evaluation for each capability - baseline, acceptance criteria, error budget, human-review points - documented before launch. Gate the launch.

+ Build the measurement. Stand up the pipelines and record keeping that track what each capability actually delivers.

+ Establish the truth. Connect each measurement directly to the source system that holds the ground truth.

+ Define what deployed systems must log. Set the trace and telemetry standard that keeps every shipped capability diagnosable and auditable.

+ Produce the numbers. Deliver the monthly and quarterly results - forecast versus actual, clean and without double-counting - that the function defends to Finance.

+ Keep the front door open. Run the record intake so every AI idea is captured, and nothing happens off the books.

+ Scope boundaries. You are not the claim owner, governance or reporting. You build the instrument that proves or disproves the claims in an auditable manner.

+ Guide, maintain and monitor the operational excellence program and activities, ensuring integration and coordination with the AI Excellence leadership

+ Manage opportunities identified for improvement using AI Excellence principles and methodologies.

+ Effectively communicate with team members, senior leaders and key stakeholders on the status, objectives, risks, and mitigation plans associated with projects, as well as ensure team members are aware of integrated project timelines.

+ Provide training in support of AI excellence objectives and the execution of chartered projects

+ Manage budget, cost, schedule and rate of return for AI excellence activities

+ Communicate clearly (written and oral) with customers, people…