Skip to content
×

QA Reviewer​/Adjudicator

Remote / Online - Candidates ideally in
Chicago, Cook County, Illinois, 60601, USA
Listing for: YPAI
Remote/Work from Home position Listed on 2026-11-06
Job specializations:
Salary/Wage Range or Industry Benchmark: 28 - 40 USD Hourly USD 28.00 40.00 HOUR

Job Description & How to Apply Below

Position: QA Reviewer / Adjudicator

Check annotation and transcription work done by others, as paid work from home. It suits precise people who give clear written feedback and reject work that fails the criteria. Prior annotation, transcription or review experience is a plus, not a requirement.

What the work is for

Your reviews decide which work goes into a delivered dataset. Work must be reviewed before a project accepts it.

The work
  • Review sampled batches against the written acceptance criteria. Score them using the project's rating criteria.
  • Resolve disagreements between annotators. Record your reason and give clear feedback.
  • Measure how often annotators agree, and help calibrate them where they drift apart.
  • Report recurring errors and guideline gaps so the instructions improve.
What to expect
  • Review and adjudication run in YPAI's own review console, next to the tool the annotators used.
  • Each project has its own acceptance criteria, and batches can be annotation or transcription.
You need
  • Precision, and the willingness to reject work that fails the written criteria.
  • Structured, consistent judgement and clear written feedback.
  • 18 years or older.
Good to know
  • You judge by the written criteria, even where you would have labelled an item differently.
  • Work comes project by project, and there can be gaps between projects.
Pay

$28–$40/hr rate shown is for the United States. This role is open in 12 countries, with local rates; pick your country on YPAI.

YPAI pays every two weeks for approved work via Pay Pal, Wise or bank transfer. Work is by invitation after your profile is reviewed.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary