Lead Software QA Engineer, AI Software/Platform Team
Job in
Milpitas, Santa Clara County, California, 95035, USA
Listed on 2026-09-16
Listing for:
Jobtailor
Full Time
position Listed on 2026-09-16
Job specializations:
-
Software Development
AI QA / Validation Engineer, Cloud Engineer - Software
Job Description & How to Apply Below
- Lead the quality strategy for large-scale Generative AI products and platforms
- Define validation approaches for AI services, distributed systems, and end-to-end customer experiences
- Design scalable testing and automation across AI pipelines, APIs, user interfaces, federated microservices, and multi-tenant SaaS architectures
- Establish release-readiness practices using quality gates, test traceability, representative environments, and data-driven Go/No-Go criteria
- Analyze model degradation, system failures, and test instability
- Drive root-cause analysis and improve AI platform reliability and resilience
- Partner with Engineering, Product, UX, Dev Ops, Documentation, and Customer Engineering
- Mentor QA engineers and advance quality-first engineering practices across teams
- BS in Computer Science, Engineering, or a related field with 12+ years of relevant experience; or a Master’s of Science Degree with 8+ years of related experience, or a PhD with 5+ years of related experience
- Experience designing and implementing test strategies, automation frameworks, and test infrastructure for distributed software systems, cloud platforms, or SaaS products
- Python development experience
- Experience with automated testing frameworks such as Pytest, Playwright, Selenium, or equivalent
- Experience validating frontend and backend systems, REST and/or GraphQL APIs, service integrations, CI/CD pipelines, and distributed microservice architectures
- Experience defining release-quality criteria
- Experience diagnosing complex system failures using test results, logs, metrics, and other engineering data
- Preferred: experience testing Generative AI, AI/ML platforms, AI agents, LLM-powered applications, or other AI-based products
- Preferred: experience designing AI-agent-assisted QA workflows using Cursor, Claude, Codex CLI, or equivalent
- Preferred: experience testing multi-tenant cloud platforms and AI test environments involving datasets, model versions, feature flags, Kubernetes, and ArgoCD
- Preferred: experience building scalable test frameworks and establishing quality practices across multiple engineering teams
- Preferred: knowledge of security, privacy, data governance, or compliance requirements for enterprise SaaS and AI products
Demonstrates expertise in leading quality strategies for Generative AI products, including designing scalable testing and automation frameworks for distributed systems and cloud platforms. Proficient in defining release-quality criteria and conducting root-cause analysis to enhance platform reliability.
Highest-signal resume keywords- Generative AI Testing
- Python Development
- Automated Testing Frameworks
- Test Strategy Design
- Cloud Platform Validation
- Test Strategy Design
- Automation Frameworks
- Distributed Systems Testing
- REST APIs Validation
- GraphQL APIs Validation
- CI/CD Pipeline Testing
- Model Degradation Analysis
- Root-Cause Analysis
- Quality Gates Definition
- Data-Driven Go/No-Go Criteria
- Mentoring
- Collaboration
- Leadership
- Generative AI
- AI/ML Platforms
- Multi-Tenant SaaS
- Data Governance
- Compliance Requirements
- Pytest
- Playwright
- Selenium
- Kubernetes
- ArgoCD
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×