Psychology Expert; LLM Evaluation

Create psychology prompts, research topics with AI assistance, and rate large language model responses for accuracy and quality. This remote, asynchronous role offers up to $55 per hour and less than 20 hours per week.

Remote Hourly · $55/hr

$55/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Posted

Open to applicants in

United States

You will help evaluate large language models, or AI systems that generate text. Your work will focus on psychology topics and on whether model responses explain specialized concepts accurately and clearly.

The work is remote and asynchronous, with flexible participation and assignments based on project availability.

• Create prompts that test knowledge of psychology concepts and specialized areas.
• Evaluate AI-generated responses for quality and accuracy.
• Research psychology topics with assistance from AI tools.
• Complete tasks that test scientific and language understanding.
• Use psychology and research judgment when comparing model responses with accurate domain knowledge.

This is a part-time contractor role for someone with advanced psychology knowledge and specialized disciplinary or research expertise. Experience creating domain-specific prompts, evaluating AI responses, or conducting psychology research may help you contribute effectively.

• Pay:
  Up to $55 per hour.
• Time:
  Less than 20 hours per week.
• Location:
  
  Open to candidates in the United States.
• Education:
  
  A master's degree from a US institution is required.
• Requirements:
  Advanced psychology knowledge, clear explanation skills, independent work habits, and strong judgment when assessing model responses.

AI training is the human work behind artificial intelligence, including writing prompts and reviewing model responses. Open Train is a free platform where people find AI training and data-labeling projects, build a profile, and apply to opportunities in one place.