Medical Doctor; Specialist

In this hourly, remote contractor role, you will work as a Medical Doctor (Specialist) Subject Matter Expert (SME) to review AI-generated clinical responses and/or create expert medical content, evaluating reasoning quality and step-by-step clinical problem-solving while providing precise written feedback. You will assess solutions for accuracy, clarity, safety, and adherence to the prompt; identify errors in clinical methodology, differential diagnosis, risk stratification, red-flag recognition, test interpretation, and treatment planning;

fact-check medical information; write high-quality explanations and model solutions that demonstrate correct reasoning; and rate and compare multiple responses based on correctness and reasoning quality.

Board-certified/board-eligible specialists across a range of fields, including but not limited to Internal Medicine, Family Medicine, Emergency Medicine, Pediatrics, OB/GYN, Cardiology, Neurology, Psychiatry, General Surgery, Anesthesiology, Critical Care, Radiology, Oncology, Dermatology, Orthopedics, Gastroenterology, Pulmonology, Nephrology, Endocrinology, Infectious Disease, and Pathology are welcomed.

This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of Super Annotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your healthcare expertise directly helps improve the world’s premier AI models by making their clinical and public-health reasoning more accurate, reliable, and clearly explained.

There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

• Develop AI Training Content:
  Create detailed prompts and gold-standard answers across clinical topics aligned to your specialty, ensuring accuracy and appropriate scope.
• Optimize AI Performance:
  Evaluate and rank AI responses to enhance correctness, safety, clarity, and contextual relevance.
• Ensure Model Integrity:
  Test AI outputs for inaccuracies, unsafe recommendations, and bias; validate reliability across use cases and patient populations.

• MD/DO (or equivalent) with completed specialty training (residency/fellowship as applicable) and board eligibility/certification (or local equivalent).
• 5+ years of post-training clinical experience in a specialty setting (hospital, outpatient, academic, or community practice).
• Confident in advanced clinical reasoning: differential diagnosis, triage, red flags, and escalation pathways appropriate to specialty practice.
• Strong understanding of disease processes, guideline-based care, diagnostic pathways, and patient-safety considerations within your specialty.
• Exceptional attention to detail when fact-checking clinical content and identifying unsafe assumptions, missing contraindications, inappropriate tests/therapies, or misinterpretation of results; minimum C1 English proficiency.
• Comfortable evaluating answers for internal consistency (timelines, physiology, dosing/contraindications where relevant), appropriateness for setting (ED vs inpatient vs outpatient), and risk/benefit tradeoffs.
• Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
• Prior experience with AI data training/annotation, guideline work, utilization review, clinical documentation review, or healthcare editorial QA is strongly preferred.