Mathematician AI Model Evaluation

Shape and evaluate advanced AI systems through rigorous mathematical reasoning, problem-solving, computational work, and clear written explanations. This remote contract role focuses on creating and assessing challenging mathematics tasks across undergraduate through Ph.D.

-level subject areas.

• Design original, challenging mathematics problems that test large language model reasoning in multi-step, abstract, and proof-based settings.
• Solve problems independently and produce detailed, logically structured solutions with clear justifications.
• Review model-generated solutions, identify mathematical errors and missing arguments, and provide precise feedback, annotations, and corrections.
• Help define mathematics evaluation benchmarks spanning early undergraduate through Ph.D.
  
  -level curricula.
• Design precise, closed-ended computational prompts, write reliable Python solutions, validate numerical answers, and provide clear rationales using approved scientific libraries.
• Complete theorem-prover work in Lean, including translating mathematical problems and proofs into formal language and verifying that formal proofs compile correctly.
• Break down complex mathematical concepts into clear explanations using simple language, visuals, and examples.

• Strong mathematical foundation at engineering entrance-exam and graduate-program levels.
• Research, analytical, creative, and lateral-thinking skills.
• Ability to solve complex mathematics problems with a structured, logical approach.
• Ability to provide constructive feedback and detailed annotations.
• Excellent structured communication and collaboration skills for a remote environment.
• Self-motivated, able to work independently, and able to work efficiently.
• Desktop or laptop with a reliable internet connection.

Candidates pursuing a Master’s, Ph.D., or postdoctoral degree in Mathematics, Applied Mathematics, Statistics, or a related field are eligible and encouraged to apply.

• Fully remote contract, independent-contractor assignment.
• Choose a commitment of 20, 30, or 40 hours per week.
• Commit at least 4 hours per day, with a minimum of 20 hours per week.
• Maintain 4 hours of overlap with Pacific Time.
• This contractor engagement does not include medical coverage or paid leave.