Philosopher AI Benchmark Authoring and Review

Create and review rigorous academic assessment content that supports AI research benchmarks across Formal Ontology and Knowledge Representation, AI Ethics, Applied Epistemology, Philosophy of Technology and Robotics, and Philosophy of Science.

• Work in either question authoring or question verification.
• For authoring assignments, develop original, challenging multiple-choice questions in your philosophy specialty, assign a difficulty rating, and submit work for review.
• For verification assignments, assess existing questions for accuracy, clarity, rigor, completeness, precision, and solvability; revise them when needed and document the rationale for each change.
• Design questions that evaluate deep conceptual understanding rather than surface-level recall, with all necessary information clearly defined within the prompt.
• Rate questions as Medium, introductory undergraduate;
  Hard, advanced undergraduate; or Expert, postgraduate and above.
• Provide one correct answer and nine plausible, subtly incorrect alternatives.
• Write clear, concise step-by-step solution explanations in Markdown.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals or university repositories.

• PhD or doctoral candidacy in Philosophy or a closely related field.
• A master''s degree may be considered for candidates with exceptional depth in a specific philosophy subdomain.
• Strong knowledge of philosophical argumentation, formal logic, and canonical texts across traditions.
• Research publications or philosophy teaching experience is a strong advantage.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

Fully remote, asynchronous hourly work.

Expected commitment of at least 10 hours per week.

Compensation $50 to $63 per hour.