AI Testing & Automation Engineer; Python/LLM Evaluation
Listed on 2026-10-17
-
Software Development
Python, AI QA / Validation Engineer, AI Engineer (Applied/Software), AI Reliability/ Performance Engineer
Reply is seeking a mid/senior-level AI Testing & Engineering Specialist with strong Python expertise to build a next-generation testing framework for generative AI agents, including evaluation pipelines, synthetic data, observability, and quality metrics for LLM-based systems.
You will collaborate across AI engineering, data pipelines, and QA to design scalable testing infrastructure and contribute to standards for production AI validation.
We would love to welcome a new AI Testing & Automation Engineer (Python/LLM Evaluation) to our organisation in Greater London, England, United Kingdom.
We have an opening for a AI Testing & Automation Engineer (Python/LLM Evaluation) in Greater London, England, United Kingdom within IT & Technology, Engineering.
This role, AI Testing & Automation Engineer (Python/LLM Evaluation) at Reply, could be your next opportunity.
Are you ready to take on the AI Testing & Automation Engineer (Python/LLM Evaluation) role at Reply?
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).