QA Reviewer/Adjudicator
Listing for:
YPAI
Remote/Work from Home
position
Listed on 2026-11-06
Job specializations:
-
Research/Development
Job Description & How to Apply Below
Check annotation and transcription work done by others, as paid work from home. It suits precise people who give clear written feedback and reject work that fails the criteria. Prior annotation, transcription or review experience is a plus, not a requirement.
What the work is forYour reviews decide which work goes into a delivered dataset. Work must be reviewed before a project accepts it.
The work- Review sampled batches against the written acceptance criteria. Score them using the project's rating criteria.
- Resolve disagreements between annotators. Record your reason and give clear feedback.
- Measure how often annotators agree, and help calibrate them where they drift apart.
- Report recurring errors and guideline gaps so the instructions improve.
- Review and adjudication run in YPAI's own review console, next to the tool the annotators used.
- Each project has its own acceptance criteria, and batches can be annotation or transcription.
- Precision, and the willingness to reject work that fails the written criteria.
- Structured, consistent judgement and clear written feedback.
- 18 years or older.
- You judge by the written criteria, even where you would have labelled an item differently.
- Work comes project by project, and there can be gaps between projects.
$28–$40/hr rate shown is for the United States. This role is open in 12 countries, with local rates; pick your country on YPAI.
YPAI pays every two weeks for approved work via Pay Pal, Wise or bank transfer. Work is by invitation after your profile is reviewed.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction