Chemistry; PhD Expert - Ai Training Evaluation

Role Overview

We partner with leading AI teams to improve the quality, usefulness, and reliability of conversational AI systems.

Engagement Type: Independent Contractor

Work Mode: Fully Remote

Schedule: Flexible (Project-Based)

• Accurate mechanistic reasoning
• Quantitative precision
• Strong command of chemical theory and application

This role focuses on evaluating and improving how AI models reason about, explain, and communicate chemistry concepts across foundational and advanced topics.

• Write and refine prompts to guide AI model behavior in chemistry contexts
• Evaluate AI-generated responses for:
  • Scientific accuracy
  • Mechanistic correctness
  • Quantitative reasoning
• Conduct fact-checking using authoritative sources and domain expertise
• Annotate responses by identifying:
  • Strengths
  • Weak reasoning
  • Conceptual inaccuracies
• Assess explanation clarity and structure for different audience levels
• Ensure responses align with conversational guidelines and evaluation standards
• Apply structured taxonomies, benchmarks, and detailed review frameworks

• PhD in Chemistry or a closely related field
• Deep expertise in one or more of the following domains:
  • Organic & Biological Chemistry
  • Inorganic & Materials Chemistry
  • Physical & Theoretical Chemistry
  • Analytical & Instrumental Chemistry

• Significant experience using large language models (LLMs)
• Strong understanding of how LLMs are used and where they fail
• Excellent technical writing and explanation skills
  
  Exceptional attention to detail
  
  Experience reviewing or editing academic or technical writing

• Experience with RLHF, AI model evaluation, or data annotation
• Teaching or mentoring experience
• Familiarity with structured evaluation rubrics or benchmarking systems

• You identify subtle inaccuracies or weak reasoning in chemistry outputs
• Your feedback improves scientific rigor and clarity
• You deliver reproducible evaluation artifacts
• AI systems become more reliable in chemistry-related applications

• Apply PhD-level expertise to frontier AI development
• Contribute to high-impact AI research beyond traditional academic roles
• Flexible schedule with project-based autonomy
• Competitive compensation aligned with expertise

• Independent Contractor engagement
• Fully remote with flexible working schedule
• Project-based work (may be extended or concluded based on needs and performance)
• Weekly payments via Stripe or Wise
• Unable to support H1-B or STEM OPT candidates at this time