More jobs:
Remote | Member of Technical Staff, Medical Research
Remote / Online - Candidates ideally in
Philadelphia, Philadelphia County, Pennsylvania, 19117, USA
Listed on 2026-10-02
Philadelphia, Philadelphia County, Pennsylvania, 19117, USA
Listing for:
24-MAG
Full Time, Remote/Work from Home
position Listed on 2026-10-02
Job specializations:
-
Healthcare
AI Evaluation, Clinical Research, Medical Science -
Research/Development
AI Evaluation, Clinical Research, Medical Science
Job Description & How to Apply Below
We are sharing a full-time opportunity for experienced medical and healthcare researchers with deep expertise in clinical reasoning, evidence synthesis, healthcare research, benchmarking, and AI evaluation to contribute to advanced research on trustworthy healthcare-focused AI systems.
Selected professionals will design rigorous evaluation frameworks, develop benchmark datasets and validation environments, analyse medical reasoning and failure patterns, and collaborate with clinicians, researchers, and engineers to improve AI systems supporting healthcare, biomedical, and clinical workflows.
Key Responsibilities Healthcare AI Evaluation Frameworks- Design evaluation frameworks for AI systems operating in medical and healthcare domains
- Develop benchmark structures, scoring methodologies, and clinical quality rubrics
- Define validation protocols for healthcare-oriented AI systems
- Establish consistent standards for measuring medical reasoning and decision-support quality
- Refine evaluation criteria as model capabilities and healthcare use cases evolve
- Conduct applied research on medical reasoning and evidence-based decision-making
- Analyse clinical workflows and healthcare information-synthesis processes
- Evaluate the quality and relevance of medical and biomedical evidence
- Apply research-design principles to healthcare-focused AI evaluation
- Translate complex medical findings into structured research conclusions
- Develop benchmark datasets based on realistic healthcare and biomedical scenarios
- Create evaluation environments reflecting practical clinical and research workflows
- Design tasks that test reasoning, evidence integration, and healthcare decision support
- Support development of agentic medical and healthcare evaluation workflows
- Ensure benchmark design reflects meaningful real-world healthcare challenges
- Analyse model performance across medical and healthcare use cases
- Identify reasoning weaknesses, failure patterns, and safety considerations
- Evaluate reliability across clinical, biomedical, and healthcare decision-support scenarios
- Investigate where AI-generated outputs diverge from professional standards
- Produce structured recommendations for improving model quality and trustworthiness
- Collaborate with clinicians, researchers, engineers, and multidisciplinary stakeholders
- Produce research reports, evaluation methodologies, and best-practice guidelines
- Contribute to healthcare AI benchmarking and reliability standards
- Monitor developments in medicine, healthcare delivery, biomedical research, and AI
- Help shape rigorous industry practices for evaluating healthcare-focused AI systems
- Advanced degree in Medicine, Public Health, Nursing, Pharmacy, Biomedical Sciences, Epidemiology, Health Economics, or a related healthcare field
- Relevant credentials may include MD, DO, PhD, MPH, PharmD, or equivalent advanced qualifications
- Deep expertise in clinical practice, healthcare operations, biomedical research, public health, healthcare analytics, or evidence-based medicine
- Demonstrated experience conducting medical, clinical, biomedical, or healthcare research
- Strong understanding of research design and evidence evaluation
- Strong knowledge of healthcare decision-making processes
- Excellent analytical reasoning and scientific communication skills
- Experience working across multidisciplinary research, healthcare, technology, or policy environments
- Familiarity with digital health or clinical decision-support systems is advantageous
- Experience with healthcare analytics or health technology assessment is beneficial
- Knowledge of healthcare quality measurement, clinical guidelines, evidence synthesis, or benchmarking is valuable
- Published medical, clinical, healthcare, or biomedical research is advantageous
- Experience with clinical studies, systematic reviews, or healthcare evaluation initiatives is beneficial
- Experience with AI evaluation or benchmarking is useful but not required
- Full-time engagement
- Fully remote
- Compensation: $400,000--$800,000/year
- Work will involve healthcare AI evaluation, medical research, benchmark development, evidence synthesis, and reliability analysis
- Assignments may span clinical reasoning, healthcare decision support, biomedical research, healthcare analytics, and agentic medical workflows
- Strong research-design, evidence-evaluation, and healthcare-domain…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×