Medicine LLM Evaluation Expert

Review and improve medicine-focused large language model responses, create expert prompts, and research specialized topics remotely. The partner title and supplied description name different subjects. Review the duties and qualifications before applying.

Remote Hourly · $125/hr

$125/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Posted

Open to applicants in

United States

The partner title and supplied description name different subjects. Review the duties and qualifications before applying.

You will help evaluate how well large language models understand and explain medicine. The work combines medical research judgment, prompt writing, and careful review of AI-generated responses.

You will work mainly asynchronously and independently on expert tasks that test scientific and language capabilities in advanced AI systems.

• Create prompts about medicine and specialized medical topics.
• Review AI responses for scientific accuracy, clarity, and meaningful understanding.
• Research specialized medical topics with assistance from AI.
• Identify strengths and limitations in AI-generated medical explanations.
• Compare technical responses with the standards of the medical field and provide evidence-based judgments.

This project is suited to medical experts who can explain important concepts clearly and assess technical content. Experience with emerging research areas, scientific writing, medical education, or technical content evaluation can help you contribute.

• Pay:
  Up to $125 per hour.
• Work arrangement:
  Remote, asynchronous project work with flexible hours.
• Time requirement: 20+ hours per week.
• Location:
  
  Open to candidates in the United States.
• Language:
  Professional fluency in English.
• Education:
  
  M.D., D.O., or PhD from a US institution.
• Requirements:
  Strong medical expertise, research ability, clear medical communication, and comfort working independently.

AI training is the human work behind systems that learn from examples, including writing prompts and reviewing model responses. People with specialist knowledge, such as medicine, help assess whether AI explanations are accurate, clear, and useful.