AI Side by Side Factuality Evaluator Remote

We’re looking for English-fluent experts to engage on a project about the factual accuracy of AI-generated content.

As an independent contractor, you’ll review AI-generated responses, split them into individual claims, and check each claim against reliable sources. Your judgments will help build AI systems that give more accurate, trustworthy, and well-supported information.

Experts may be asked to:

• Review AI-generated responses on a wide range of topics

• Break responses into individual, verifiable claims

• Research each claim online and find credible, authoritative sources

• Decide whether each claim is accurate, inaccurate, or unverifiable, paying close attention to small differences in wording

• Make independent, evidence-based calls, including in ambiguous cases

• Follow detailed evaluation guidelines and record clear, consistent decisions with supporting evidence

This project may be a strong match for experts who:

• Are fluent in English, with strong reading comprehension and writing skills

• Have strong critical-thinking and analytical skills

• Have strong web research skills and can tell reliable sources from unreliable ones

• Pay close attention to detail, especially when spotting individual claims and subtle wording differences

• Are comfortable researching many kinds of topics, including unfamiliar ones

• Can understand detailed instructions and apply them consistently

• Contractor's services are provided on an independent contractor basis only and do not create any right or expectation of continued engagement or employment.
• Projects may be extended, shortened, or concluded early, including for reasons tied to project needs and the quality of deliverables; nothing in this engagement guarantees any minimum amount of work.
• Any engagement is fully remote, can be completed on your own schedule, and contractors are free to accept or reject any project opportunity.
• Payment for services provided will be issued weekly via Stripe or Wise.
• We are unable to support H1-B or STEM OPT contractors at this time.

Meridial connects you with remote, paid AI projects that match your skills and expertise. By contributing your knowledge, you help advance the world's leading AI systems and accelerate the future of artificial intelligence. Hear from Charlie, to learn more.