Skip to content
×

QA Engineer

Job in San Antonio, Bexar County, Texas, 78201, USA
Listing for: Ai Makers
Full Time position Listed on 2026-11-15
Job specializations:
Salary/Wage Range or Industry Benchmark: 120000 - 170000 USD Yearly USD 120000.00 170000.00 YEAR

Job Description & How to Apply Below

Role overview

Establish quality controls for AI systems running in production. This role focuses on evaluating variable model outputs and connected workflows, keeping tests relevant to real usage, and determining whether a system is ready for delivery. It also tracks reliability, business claims, and gradual changes in quality or cost.

Responsibilities
  • Build and maintain evaluation sets for AI systems, updating them as real user traffic reveals new questions and edge cases.
  • Create regression checks for workflow changes, including downstream failures caused by altered outputs or formats.
  • Review business scenarios and client edge cases, assess whether results are usable, and make the release readiness decision.
  • Design a repeatable method to verify reported business outcomes on individual projects and flag claims that do not hold.
  • Monitor for quality drift and rising token costs, and create signals that surface changes early.
  • Write concise acceptance reports, defect notes, and drift findings that stakeholders can understand quickly.
Requirements
  • Ability to test AI systems whose outputs vary, using evaluation sets that reflect realistic user behavior.
  • Skill in designing regression tests across connected workflows and identifying silent downstream failures.
  • Judgment to assess edge cases and determine whether outputs are fit for business use.
  • Ability to measure and verify claimed outcomes with a repeatable, project-level method.
  • Attention to operational signals such as declining quality and increasing model costs.
  • Clear written communication for documenting findings, release decisions, and non-conformities.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary