PhD Scientist - AI Task Author at Mercor

Maximize your PhD knowledge as an AI Task Author laborate with AI labs to generate evaluation tasks that challenge existing models using your mathematical skills.

Mercor is looking for motivated PhD and Master's graduates to create AI evaluation tasks for scientific benchmarks in collaboration with top AI institutions. This part-time role requires strong knowledge in at least two subdomains of mathematics, contributing over 20 hours per week for six weeks. You will blend research and coding to craft original problems.

Key Responsibilities:

• Identify sources like papers or datasets for tasks

• Author scientific prompts based on sourced input

• Define grading criteria for evaluation tasks

• Validate tasks with top AI models for difficulty

• Ensure high standard in problem-solving capability

Requirements:

• PhD in mathematics or related area

• Expertise in numerical linear algebra or similar

• Working knowledge of Python or R required

• Git and Docker usage experience

• Bonus:
Experience in scientific software development

Bring your analytical skills to create innovative AI evaluation challenges at Mercor.