×
Register Here to Apply for Jobs or Post Jobs. X

Philosophy PhD - Assessment Specialist

Remote / Online - Candidates ideally in
New York, New York County, New York, 10261, USA
Listing for: Mercor
Remote/Work from Home position
Listed on 2026-08-22
Job specializations:
  • Science
    AI Evaluation, Academic, Research Scientist
Salary/Wage Range or Industry Benchmark: 55000 - 83000 USD Yearly USD 55000.00 83000.00 YEAR
Job Description & How to Apply Below
Location: New York

Role Overview

We are seeking expert philosophers to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core philosophy domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types:

  • Question Authoring — Create original, challenging multiple-choice questions in your area of philosophy expertise, rate their difficulty, and submit them for review.
  • Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made.
Philosophy Domains Covered

Formal Ontology & Knowledge Representation, AI Ethics, Applied Epistemology, Philosophy of Technology & Robotics, Philosophy of Science.

Key Responsibilities
  • Author original philosophy questions that test deep conceptual understanding, not surface-level recall
  • Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement
  • Rate each question's difficulty:
    Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above)
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers
  • Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format
  • Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories)
  • For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made
Ideal Qualifications
  • PhD or doctoral candidate in Philosophy or a closely related field
  • Master's degree considered for candidates with exceptional depth in a specific subdomain
  • Strong command of philosophical argumentation, formal logic, and canonical texts across traditions
  • Research publications or teaching experience in philosophy is a strong plus
  • Excellent written English and ability to express complex ideas clearly and concisely
More About the Opportunity
  • Expected commitment: 10+ hours/week
  • Asynchronous, fully remote work
#J-18808-Ljbffr
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary