More jobs:
AI Evaluation Infrastructure & Production Readiness Lead
Job in
Baltimore, Anne Arundel County, Maryland, 21276, USA
Listed on 2026-09-12
Listing for:
Ports North
Full Time
position Listed on 2026-09-12
Job specializations:
-
IT/Tech
AI Evaluation
Job Description & How to Apply Below
We have partnered with our client in their search for an AI Evaluation Infrastructure & Production Readiness Lead (Contract position).
Responsibilities- Lead the development of client's enterprise AI evaluation and production readiness framework, establishing standardized testing, validation, governance, and go/no-go criteria that ensure AI systems are accurate, safe, compliant, and ready for enterprise deployment.
- Design and build scalable AI evaluation infrastructure, including evaluation harnesses, golden datasets, regression testing, hallucination and grounding validation, bias/fairness testing, adversarial testing, drift detection, automated monitoring, and production readiness controls.
- Partner with AI Engineering, Risk, Compliance, Legal, and Model Governance teams to translate regulatory and business requirements into repeatable AI testing methodologies, vendor evaluation standards, and evidence-based reporting for enterprise AI governance.
- 7+ years of experience in AI/ML Engineering, Software Quality Engineering, Data Science, or Machine Learning, with expertise in LLM evaluation, regression testing, statistical analysis, and production validation.
- Hands-on experience building and testing enterprise LLM/ML evaluation frameworks, including hallucination detection, grounding validation, bias/fairness testing, experimental design, AI safety, policy adherence, and production readiness.
- Strong expertise in AI testing methodologies, statistical experimentation, evaluation metrics, and acceptance criteria, with experience partnering across AI Engineering, Risk, Compliance, and Legal to implement enterprise AI governance and quality controls.
- Bachelor's Degree (pref. Computer Science, Engineering, IT, Data Science, or related fields)
- 7+ years of Professional Work Experience
AI Evaluation Infrastructure & Production Readiness Lead
Location:
Remote Client Industry: Financial Services Compensation: $100+/hr About Korn Ferry
Korn Ferry unleashes potential in people, teams, and organizations. We work with our clients to design optimal organization structures, roles, and responsibilities. We help them hire the right people and advise them on how to reward and motivate their workforce while developing professionals as they navigate and advance their careers. To learn more, please visit Korn Ferry at
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×