Journalist​/Writer AI Writing Evaluation

Apply journalistic and editorial judgment to evaluate AI generated writing and help improve how next generation AI systems learn, reason, and perform. This remote contract role focuses on assessing written responses for accuracy, clarity, usefulness, tone, and adherence to instructions. Prior AI experience is not required.

• Review and compare multiple AI generated responses to writing prompts.
• Assess clarity, tone, helpfulness, and fidelity to the assigned brief.
• Assign analytical quality scores and provide concise, well reasoned written explanations for evaluation decisions.
• Identify persuasive writing that contains inaccuracies, insufficient support, or departures from the intended brief.
• Detect factual errors, logical inconsistencies, and internal coherence issues.
• Document evaluations thoroughly using provided digital content review platforms and tools.
• Collaborate asynchronously with project managers and reviewers to maintain consistent evaluation standards.
• Independently complete assigned evaluations within project timelines.

• Native or near native written English fluency.
• A completed university degree from an institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
• Professional experience as a journalist, reporter, editor, copy editor, sub editor, fact checker, ghostwriter, or published author.
• Demonstrated technical writing, content evaluation, critical analysis, written communication, editing, and fact checking skills.
• Experience evaluating work against a style guide or editorial standards.
• Strong attention to detail and the ability to assess accuracy, clarity, and audience suitability.
• Comfort working independently in a remote, virtual collaboration environment.
• Experience with annotation, AI model evaluation, or digital content review platforms is helpful but not required.

Remote contract engagement.

$90 to $140 per hour.