Software Quality Engineer
Job in
Greater London, London, Greater London, W1B, England, UK
Listed on 2026-09-12
Listing for:
Jobtailor
Full Time
position Listed on 2026-09-12
Job specializations:
-
Software Development
AI QA / Validation Engineer, AI Engineer (Applied/Software)
Job Description & How to Apply Below
Job Responsibilities
- Define and implement comprehensive quality assurance strategies and test plans for AI agents and LLM-powered applications
- Design and develop robust, scalable, and maintainable automated test frameworks
- Collaborate with product managers, machine learning engineers, and data scientists to translate AI features and model behaviors into test cases and validation criteria
- Improve testing processes and infrastructure, integrating automated checks into CI/CD pipelines
- Identify, document, track, and analyze software defects and inconsistencies
- Monitor production systems and AI model performance and contribute to post-release quality validation
- Champion quality best practices across engineering teams
- Design, manage, and maintain test data strategies and mock services
- Manage the full defect lifecycle using customer feedback and debugging logs
- Report directly to the director of engineering
- 5+ years of hands-on experience in software quality assurance or engineering, with a strong focus on testing complex distributed systems or AI/ML applications
- 5+ years of experience working with Git Hub Actions
- Proficiency in Python or Type Script for test automation
- Experience with modern testing frameworks such as Playwright
- Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and the unique challenges of testing generative AI outputs
- Experience designing, developing, or integrating agentic AI systems, AI skills, and the Model Context Protocol (MCP)
- Experience with AWS, Azure, or GCP and Docker or Kubernetes in a CI/CD environment is a big plus
- Exceptional analytical skills and keen attention to detail
- Demonstrated ability to drive initiatives independently and thrive in a fast-paced, evolving startup environment
- Must be located within 50 miles of one of the office hubs or be willing to relocate
- Must be able and willing to work in person in the office 3 days per week
- Must be legally authorized to work in the country in which the job is located
Demonstrates expertise in quality assurance strategies for AI and LLM applications, with a strong focus on automated testing frameworks and CI/CD integration. Proficient in Python or Type Script, with a solid understanding of AI/ML concepts and testing methodologies.
Highest-signal resume keywords- Quality Assurance Strategies
- Automated Test Frameworks
- Python or Type Script
- AI/ML Concepts
- Git Hub Actions
- Quality Assurance
- Test Automation
- Automated Testing Frameworks
- AI/ML Testing
- Defect Lifecycle Management
- Model Evaluation Metrics
- Data Pipelines
- Agentic AI Systems
- Playwright
- CI/CD Integration
- Analytical Skills
- Attention to Detail
- Initiative
- Adaptability
- Collaboration
- AI Agents
- LLM-Powered Applications
- Testing Complex Distributed Systems
- Mock Services
- Post-Release Quality Validation
- Git Hub Actions
- AWS
- Azure
- GCP
- Docker
- Kubernetes
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×