AI Evaluation Engineer; Data Scientist

Applications for this position close on 3rd November 2026 - 23.45pm UK Time

Help shape how people interact with some of the most ambitious AI products in government

The Incubator for AI (i.AI) is a team of ~80 builders and operators using frontier AI to improve public services across healthcare, education, planning and parliament. We combine startup pace and autonomy with the opportunity to tackle national-scale challenges.

We operate under three core principles:

Talent
:
We bring together the UK's best AI talent across a range of functions. You will work alongside exceptional researchers and top government leaders, staying at the cutting edge of technology.

Innovation
:
We set precedents for what is possible in government. We combine the pace of a start-up with the influence of being at the digital centre of government. You will test new ideas, expand what is possible, and leverage unique government data to create novel solutions.

Impact
:
We are dedicated to using AI as a tool for public good - this can mean improving outcomes in schools, boosting house building or providing more personalised support for those in need. With the backing of the Prime Minister, you will turn technical breakthroughs into real-world applications that affect millions of citizens.

i.AI's Impact and Evaluation team builds evaluation into each stage of product development, from scoping and incubation through to scaling. Team members embed within product development teams, designing and delivering robust evaluations throughout the product journey to inform product decisions and, ultimately, understand their impact on the quality and efficiency of public service delivery.

The team is now recruiting for two AI Evaluation Engineers, to implement evaluation methods and run evaluation experiments across AI products. These roles will focus on model-level evaluation, including assessment of accuracy, bias and safety.

• Design and build evaluation pipelines and experiments for AI products
• Run model and system evaluations to assess accuracy, bias, safety and overall performance
• Work closely with product and engineering teams to embed evaluation throughout the product lifecycle, from early scoping through to scaling
• Partner with domain experts to create and maintain high-quality golden datasets and evaluation benchmarks
• Analyse evaluation results and turn findings into clear, practical recommendations for product teams
• Help teams understand the impact of AI products on the quality and efficiency of public service delivery
• Contribute to reports, presentations and other outputs that communicate evaluation findings to technical and non-technical audiences
• Support the development of robust evaluation approaches that can be reused across different AI products and services

You may be a strong fit if you bring some of the following:

• Experience in a scientific, analytic or engineering role
• Excellent analytical and critical thinking skills, with the ability to synthesise complex information and draw insights from data
• Practical knowledge of experimental design and statistical hypothesis testing
• Proficient in Python
• Ability to use version control tools (e.g. git)
• Experience of evaluating generative or predictive AI/ML systems
• Experience of working as part of a software development team
• Ability to communicate technical work to a broad audience

• Backing from the Prime Minister and No10 to scope and build transformative AI projects.
• Unique opportunities to apply technology that could transform the public sector and impact citizens' lives.
• Talented, supportive and mission-driven colleagues.

• Access…