Quality Engineering Lead - Agent Evaluation & AI Platforms

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love.

We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You'll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work.

If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)

Job Summary

We are seeking seasoned Quality Lead (SDET
4) to orchestrate our enterprise release cycles and lead the quality strategy for our next-generation AI initiatives. This role is designed for a strategic technical leader who combines deep Comcast domain expertise across all 4 Lines of Business (LOBs) and Device Provisioning with specialized experience in Agentic AI validations.

You will lead the quality process from the front: running scrums, managing the end-to-end defect lifecycle, conducting structural code reviews, and serving as the principal architect for our Agent Evaluation strategies within Google ADK environments.

The AI Agentic Team designs, builds, and runs intelligent agents end to end. We own agent logic, workflows, integrations, production deployment, and ongoing performance. By combining build and operations, we deliver agentic systems that are reliable, secure, and scalable in real-world use.

Job Description

High-Impact Leadership & Process Ownership

* Agile Governance:
Run daily Scrums and stand-ups, optimizing team velocity, managing task assignments, and ensuring delivery milestones are met on time.

* Defect Triaging:
Lead rigorous defect triaging meetings. You will be the primary driver tracking high-priority issues, coordinating directly with development teams, and pushing defects to rapid closure.

* Requirement & Architecture Inception:
Embed yourself in upstream requirement meetings. You will challenge assumptions, identify missing edge cases, and establish the technical "Definition of Done."

* Business & UAT Orchestration:
Act as the strategic partner to Business teams, leading User Acceptance Testing (UAT) and translating complex technical deployments into business-ready validation.

AI Governance & Agent Evaluation Strategy

* Agentic AI Expertise:
Bring at least 2+ years of hands-on experience in Agentic AI validations, navigating the non-deterministic nature of large language models and intelligent workflows.

* Evaluation Frameworks:
Drive the strategy for Agent Evaluation techniques, ensuring the team effectively implements automated verification patterns (such as LLM-as-a-judge) within Google ADK environments.

* Prompt Engineering Oversight:
Apply deep knowledge of Prompt Engineering to validate agent behavior, test fallback mechanisms, and ensure intent optimization.

* Quality Governance & Code Reviews:
Conduct technical Code Reviews for the team's automation repositories. Ensure that Python or Type Script test scripts targeting the AI layers are modular, efficient, and scale effectively.

Comcast LOB, Provisioning & Quality Governance

* Full LOB Coverage:
Apply deep operational knowledge across all 4 Comcast LOBs (Xfinity Video, High-Speed Data, Digital Voice, and Xfinity Mobile) to ensure cross-functional workflows are flawlessly validated.

* Device Provisioning Master:
Leverage an intricate understanding of backend Device Provisioning pipelines, activation flows, and equipment states to isolate complex environments and system-level issues.

* Automation Oversight & Code Reviews:
Maintain strong technical oversight of the team's codebase. You will possess a solid understanding of test automation methodologies and basic…