Philosophy Expert
Listed on 2026-10-29
-
Research/Development
AI Evaluation, Data Annotation/ AI Labeling
Philosophers to build the argument analysis and ethical reasoning scenarios frontier AI labs use to test model judgment. After Query builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring philosophers as contractors to author and grade the argument analysis and ethical reasoning scenarios those evaluations run on. What you'll actually do
Author philosophical scenarios that test real reasoning, from argument reconstruction to applied ethical dilemmas. Write reference answers with the argumentative structure made explicit, premises, inferences, and objections laid bare. Grade model output for validity, soundness, and fair treatment of the strongest opposing view. Flag reasoning that sounds profound but equivocates, begs the question, or collapses under a counterexample.
Who this is forPhilosophers with an advanced degree and at least two years of teaching, research, or published work. Specialists in any area, ethics, epistemology, logic, philosophy of mind, political philosophy, and beyond. People who can steelman a position they reject and explain precisely where an argument fails. Writers whose prose makes hard distinctions clear rather than dressing easy ones up.
Contract and pay$50 to $100/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start. Fully remote, fully async. No fixed hours. Minimum 10 hours per week, no maximum. Scale up or down week to week. No screen recording, no keystroke monitoring, no idle timers. Independent contractor. Ongoing project work rather than single task batches.
About After QueryAfter Query is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates.
Responsibilities- Author philosophical scenarios that test argument analysis and ethical reasoning
- Write reference answers with the argumentative structure made explicit
- Grade model output for validity, soundness, and fair treatment of objections
- Flag reasoning that sounds profound but equivocates or begs the question
- Advanced degree in philosophy or a closely related field
- 2+ years of teaching, research, or published philosophical work
- Depth in an area such as ethics, epistemology, logic, or philosophy of mind
- Clear written English for constructing and evaluating arguments
- Able to commit at least 10 hours per week
- PhD and peer reviewed publications
- Formal logic or decision theory training
- Applied ethics experience such as bioethics or AI ethics
- Work stays in your specialty, judged on rigor rather than output volume
- Set your own hours and scale up or down week to week
- Weekly pay via Stripe at a rate set from your experience
- Your judgment shapes how the next generation of AI handles hard questions
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).