Lead Test Framework Architect; M​/F​/D

Agilent is building a Kubernetes-based software platform spanning instruments, applications, and shared services across multiple product lines, while embedding AI into how we build and verify that software. That software runs instruments used in over 265,000 labs worldwide, supporting work like R&D, cancer diagnostics, and food and water safety testing. We’re looking for a Lead Test Framework Architect to own the test frameworks, evaluation methods, and governance that let us ship AI-accelerated software safely in regulated GxP / 21 CFR Part 11 environments.

That calls for someone who already has hands‑on, proven depth in Kubernetes test environment architecture, AI and LLM evaluation frameworks, and regulated software validation. AI accelerates software delivery, but that acceleration exposes weaknesses downstream without a strong automated-testing control system. You'll build that control system and lead the organization in adopting it.

• Lead AI SDLC adoption for quality engineering.
• Own the strategy for AI‑assisted test authoring, execution, triage, and maintenance.
• Prove value through reference workflows, then scale adoption across product teams.
• Build AI‑native test frameworks.
• Design workflows that generate unit, contract, integration, and E2E suites from specifications and intent.
• Verify that AI‑generated tests exercise specified intent, not implementation.
• Integrate Git Hub Copilot (enterprise standard) and complementary tools (e.g., Qodo, Diffblue, Playwright AI agents, self‑healing frameworks) into CI/CD quality gates.
• Test our AI features.
• Build evaluation and regression frameworks for LLM‑ and agent‑powered product capabilities: non‑deterministic evaluation, hallucination and grounding scoring, drift detection, and AI observability using Open Telemetry GenAI conventions.
• Own the regulatory bridge.
• Integrate AI‑assisted testing into validated environments using risk‑based Computer Software Assurance (CSA), GAMP 5 (2nd Edition) and the ISPE GAMP AI Guide, and - for diagnostics software - IEC 62304.
• Preserve audit trails, traceability, and data integrity for AI‑generated artifacts.
• Establish human‑in‑the‑loop governance.
• Define risk‑scaled review checkpoints, acceptance criteria, and rollback triggers for AI‑generated code and tests.
• Define platform‑wide test architecture standards for a Kubernetes‑based microservices platform: testability‑by‑design, test environment strategy (ephemeral name spaces, environment‑as‑code), CI/CD quality gate architecture, contract testing for microservices and APIs, test data strategy (synthetic data, isolation, AI/ML data requirements), and E2E frameworks that work reliably in containerized environments.
• Instrument and report on impact.
• DORA delivery metrics augmented with AI‑specific measures (coverage delta, defect‑escape rate, mean‑time‑to‑triage, eval‑suite pass rates).
• Lead the change effort - champions, enablement, playbooks - that drives durable adoption.

• 10+ years of software engineering, with 3+ years in test architecture or quality engineering architecture roles.
• Demonstrated daily, hands‑on use of AI‑assisted development and testing tools (Git Hub Copilot, Claude Code, Cursor, or equivalent) with the ability to speak concretely to effective usage patterns and failure modes.
• Deep hands‑on Kubernetes expertise for test environment design: ephemernal namespace provisioning, container‑based test infrastructure, environment‑as‑code.
• Strong experience designing multi‑level test automation frameworks: unit, contract, integration, E2E, and performance testing in distributed systems.
• CI/CD pipeline architecture and quality gate integration (Git Hub Actions, Jenkins, or equivalent).
• Contract testing experience…