AI Quality Assurance Lead - SC Cleared

AI Test & Evaluation Engineer (Python / Pytest)

Contract Rate: Up to £600 - £650/day (Inside IR35)

Location: Hybrid (1 day per week in London, Cardiff, or Glasgow)

Clearance: Active SC Clearance required

We are seeking an experienced AI Test & Evaluation Engineer to design, develop, and execute evaluation frameworks for AI platforms, including M365 Copilot agents. This role focuses on building automated test suites and validation pipelines to evaluate AI-specific quality attributes, performance, and reliability within complex technical environments.

• Framework Design & Execution: Lead the end-to-end design, development, planning, and execution of test and evaluation frameworks tailored for AI solutions, including work on the Cyber RIIO tech stack and M365 Copilot agents.

• Automated Testing & Pipelines: Utilize robust Python skills to build scalable automated test suites and validation pipelines using PyTest.

• AI Quality Attribute Analysis: Rigorously test and evaluate AI-specific criteria including accuracy, relevance, faithfulness, hallucination rates, robustness, bias, fairness, security, privacy, and explainability.

• Data Science Project Delivery: ...