More jobs:
Job Description & How to Apply Below
Applied Health & Medicine Benchmark Specialist
Position:
Applied Health & Medicine Benchmark Specialist
Type:
Hourly Contract
Compensation:
$94–$119/hour
Location:
Remote
About the Opportunity
This opportunity is for experienced medical and health science professionals to contribute their expertise to an advanced AI research and evaluation project with Mercor.
You will author and verify high-quality academic assessment content across clinical medicine, surgery, medical imaging and diagnostics, pharmacovigilance, healthcare management and economics, rehabilitation, and allied health . The work focuses on developing rigorous benchmarks that evaluate AI systems on deep conceptual understanding, clinical reasoning, accuracy, and professional judgment .
Experts with advanced knowledge in relevant health and medicine domains are encouraged to apply.
Responsibilities
Develop original, challenging health and medicine multiple-choice questions that assess deep conceptual understanding rather than surface-level recall.
Create realistic assessment scenarios across clinical medicine, surgery, diagnostics, pharmacovigilance, healthcare management, rehabilitation, and allied health .
Provide 1 correct answer and 9 plausible but subtly incorrect alternatives for each question.
Ensure questions are self-contained, unambiguous, precise, and appropriately challenging .
Rate each question according to difficulty: Medium, Hard, or Expert .
Develop clear, step-by-step solutions explaining the correct reasoning and answer.
Provide 1–5 reputable academic references for each question, including peer-reviewed research and clinical guidelines.
Review and verify pre-written questions for medical accuracy, clarity, completeness, precision, and solvability .
Identify and correct inaccurate, ambiguous, or unsupported content.
Document and justify any modifications made during the verification process.
Evaluate AI-generated health and medical responses and identify technical errors, unsupported conclusions, and gaps in reasoning .
Ensure benchmark content reflects graduate-level professional and academic medical knowledge rather than basic textbook or examination-level recall.
Required Qualifications
MD, DO, PhD, or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or a closely related field.
Strong command of graduate-level medical knowledge and clinical reasoning .
Strong understanding of biomedical research methodology and academic assessment design .
Expertise in one or more relevant health and medicine domains.
Ability to evaluate complex medical information for accuracy, rigor, and scientific validity .
Excellent written English and ability to communicate complex medical concepts clearly and concisely.
Strong analytical and critical-thinking skills.
Ability to independently research and reference peer-reviewed literature, clinical guidelines, and other authoritative sources .
Preferred Qualifications
Experience in clinical medicine, medical research, healthcare, or academic medicine .
Board certification or equivalent professional credentials.
Research publications in medicine, biomedical sciences, public health, or related fields.
Advanced specialization in clinical medicine, surgery, medical imaging, diagnostics, pharmacovigilance, healthcare management, rehabilitation, or allied health .
Experience creating academic assessments, examination questions, training materials, or evaluation rubrics .
Experience with AI evaluation, AI training, benchmark development, or quality assurance is a plus.
Experience reviewing or publishing peer-reviewed academic or scientific content .
Compensation
$94–$119/hour
Hourly contract engagement.
Fully remote and asynchronous opportunity.
Opportunity to apply advanced medical and health science expertise to AI research, evaluation, and benchmark development.
Eligibility
Medical and health science professionals with advanced academic or professional expertise are encouraged to apply.
Candidates with MD, DO, PhD, or doctoral-level training in relevant disciplines are particularly suited to the role.
Expertise in one or more covered health and medicine domains is applicable.
Candidates with clinical experience, research publications, or specialized professional credentials are strongly encouraged to apply.
Application Process
Apply for the Applied Health & Medicine Benchmark Specialist position.
Complete the required screening process.
Demonstrate relevant medical, health science, research, or clinical expertise .
Complete any required health and medicine evaluation or assessment.
Complete onboarding if selected.
Begin authoring, reviewing, and evaluating AI-generated health and medicine assessment content .
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×