Automation Test Architect

Responsibilities

• Define and own the test automation architecture and multi‑layer strategy (UI/API/contract/integration/e2e), aligned to product risk and release cadence.
• Establish automation standards, patterns, and reference implementations (framework structure, page‑object/screenplay usage, test data patterns, reporting).
• Drive shift‑left testing practices (contract testing, component testing, pre‑merge validation) and reduce reliance on fragile end‑to‑end tests.
• Design and implement testing approaches for non‑deterministic AI outputs, including confidence/threshold‑based assertions, semantic similarity checks and rubric‑based validation, goldens/benchmark datasets and evaluation harnesses, hallucination and groundedness testing strategies, regression detection across model/prompt/version changes.
• Define AI test coverage across accuracy, robustness, bias/safety (as applicable), performance, and reliability.
• Build and scale high‑throughput automation projects that are reliable, fast, and easy to extend.
• Improve test execution time, reduce flaky tests, and optimize CI/CD pipelines (parallelization, test selection, retries with guardrails).

• 8–12+ years in Quality Engineering / Test Automation with architect‑level ownership of frameworks and strategy.
• Proven experience designing scalable automation across API testing (contract + integration) and UI automation with stable locator strategies (test IDs, accessibility roles) and a test data strategy and environment reliability.
• Strong programming skills in at least one modern language (Java, Python, Type Script/JavaScript, C#).
• Expertise with automation tools/frameworks: UI (Playwright, Cypress, Selenium), API (REST‑assured, Super Test, Postman/Newman, pytest), CI (Git Hub Actions, Jenkins, Azure Dev Ops).
• Demonstrated ability to reduce flakiness and improve execution speed through engineering solutions.