Lead Software Test Automation Engineer
Job in
Coppell, Dallas County, Texas, 75099, USA
Listing for:
Wolters Kluwer
Full Time
position
Listed on 2026-11-11
Job specializations:
-
Software Development
Job Description & How to Apply Below
The engineer will define validation approaches for probabilistic AI outcomes, including evaluation datasets, threshold- and rubric-based validation, groundedness, regression detection, robustness, performance, and reliability, while embedding automation into CI/CD and production-quality practices. Essential Duties and responsibilities Define and own the test automation technical design and risk-based, multi-layer strategy across UI, API, contract, component, integration, end-to-end, data, and platform testing.
Establish automation standards, patterns, and reference implementations covering framework structure, coding practices, reusable components, test data, diagnostics, reporting, and maintainability.
Drive shift-left quality practices through component, contract, API, and pre-merge validation, reducing unnecessary reliance on slow or fragile end-to-end tests.
Design and implement validation approaches for non-deterministic AI and agentic outcomes, including confidence- and threshold-based assertions, semantic and rubric-based evaluation, benchmark datasets, evaluation harnesses, groundedness testing, and regression detection across model, prompt, context, and agent changes.
Define AI quality coverage and measurable acceptance criteria across accuracy, robustness, groundedness, safety where applicable, performance, reliability, and cost-aware execution in partnership with AI Engineering, Product, and Software Engineering.
Build and scale high-throughput automation suites that are reliable, fast, diagnosable, and easy to extend across products and delivery teams.
Improve automation execution time and stability through parallelization, intelligent test selection, dependency control, deterministic test data, and disciplined retry strategies. Integrate automated validation into CI/CD with appropriate pull-request checks, scheduled suites, deployment gates, and release-readiness criteria.
Standardize test observability, including logs, traces, screenshots or video where appropriate, artifacts, failure diagnostics, and actionable quality dashboards covering execution health, flakiness, coverage, and escaped defects.
Define effective practices for test environments, test data management, service virtualization, external dependency control, and repeatable environment setup.
Serve as the technical authority for software test automation; lead design and code reviews, coach engineers on automation design and code quality, and establish maintainable engineering standards. Influence product and engineering roadmaps by translating customer, technical, operational, and delivery risks into clear validation priorities and quality investments.
Partner with Product, Software Engineering, AI Engineering, Security, Dev Ops, and Operations to ensure functional and nonfunctional quality is engineered throughout the product lifecycle.
Use production telemetry, incidents, customer issues, and defect escape patterns to continuously improve automated coverage and prevent recurrence.
Job Qualifications
Education:
Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related field, or equivalent practical experience. Master’s degree in a relevant technical or business discipline is preferred. Required Experience /
Skills:
8+…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction