AI Automation tester Job McLean area,Virginia USA,Quality Assurance

AI Automation Tester

Our client, a Real Estate and Financial Services company, is looking for an AI Automation tester for their McLean, VA location.

Responsibilities:

Design and implement agentic testing patterns that can be adopted by multiple Underwriting teams (and later other domains).
Create reference implementations (sample repos / templates) demonstrating:
Test generation assistance (from requirements, APIs, contracts, schemas)
Test maintenance assistance (auto-updating selectors/contracts, flaky test triage)
Failure analysis assistance (root cause suggestions, log correlation, defect drafting)
Establish a standard architecture for test code organization, tagging, data management, and execution across UI + API + service layers.
Coverage standards, templates, and governance
Define and publish coverage standards (what "good" looks like) including:
Minimum coverage expectations by service/component
Test type mix (unit vs API vs UI vs contract vs integration)
Risk-based prioritization and traceability to requirements
Provide templates usable across teams:
Test plan templates
Test case/spec templates (Gherkin-style or equivalent)
Definition of Ready / Definition of Done quality checklists
Create a scalable tagging/metadata strategy (e.g., feature, service, risk, priority, data sensitivity) to support reporting and quality gates.
GenAI-assisted reporting and quality insights across microservices
Build automated reporting that aggregates test + service data across multiple microservices, such as:
Test execution results (Karate/Playwright + CI runs)
Service health signals (logs/metrics/traces if available)
Defect signals (issue tracker metadata if available)

Requirements:

GenAI / LLM + agentic development
Hands-on experience building LLM-powered agents (tool-using, multi-step reasoning, guardrails).
Experience with prompting patterns, structured outputs (JSON schemas), evaluation, and reducing hallucinations.
Ability to design agent workflows for:
Test generation/augmentation
Requirements review and completeness validation
Report generation and summarization
Git Hub platform + GHCP (Copilot) for engineering workflows
Strong proficiency with Git Hub Copilot in day-to-day development.
Deep experience with Git Hub platform capabilities:
Git Hub Actions (CI/CD pipelines, reusable workflows, composite actions)
PR checks, branch protections, CODEOWNERS, templates
Automation via Git Hub APIs/webhooks (as needed)
Test automation engineering (framework expertise)
Advanced experience designing and implementing automation with:
Karate (API testing, contract-like checks, data-driven testing, mocks)
Playwright (UI automation, selectors strategy, parallelization, trace/video artifacts)
Strong understanding of test design and coverage:
Happy path scenarios
Negative/validation scenarios
Edge/boundary scenarios
Data setup/teardown strategies and test isolation

Why Should You Apply?