Generalist Expert - Data Evaluation

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Experienced Generalist

Type: Contract

Compensation: $45–$60/hour

Location: Remote

Commitment: 10–25 hours/week

• Create and evaluate base prompts across a range of generalist topics.
• Review and revise AI-generated responses for clarity, accuracy, and alignment with human reasoning.
• Develop prompt-response iterations using variations in length, style, and system prompts.
• Contribute to benchmarking efforts by identifying failure points in model responses.
• Create rubrics to evaluate the prompts and apply consistent quality standards across diverse content types.

• 2+ years of experience in research, education, writing, editing, or adjacent analytical fields.
• Proven ability to communicate complex topics clearly and concisely.
• Strong attention to detail and critical thinking skills.
• Comfort working independently with evolving task guidelines.

• Familiarity with LLMs or AI-assisted writing tools.

• Submit your resume to get started.
• Complete the Domain Expert interview.
• We aim to follow up within a few business days.

• For details about the interview process and platform information, please check:
• For any help or support, reach out to:

PS:
Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.