Remote Legal Expert - AI Trainer

Remote Legal Expert AI Trainer 105105 per hour
• Mission, Texas, US

Location:

Geography restricted to USA, EU, UK, Canada. Type:
Full-time or Part-time Contract Work.

Fluent Language

Skills Required:

English.

Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. In legal contexts, precision, clarity, and correct reasoning are critical. This project focuses on evaluating and improving conversational AI behavior when responding to legal questions, explanations, and analyses.

Your expertise helps ensure model responses reflect accurate legal understanding, appropriate reasoning, and responsible communication aligned with real-world legal practice.

• Write and refine prompts to guide model behavior in legal use cases
• Evaluate LLM-generated responses to legal queries for accuracy, reasoning, clarity, and completeness
• Conduct fact-checking using trusted public sources and authoritative references
• Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
• Assess tone, completeness, and appropriateness of responses for real-world legal scenarios
• Ensure model responses align with expected conversational behavior and system guidelines
• Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines

• You have a minimum of 5 years of real-world professional experience in Law, supported by an associated expert degree (e.g., JD, LLB, LLM, or equivalent)
• You have experience in one or more of the following sub-domains:
  • Corporate, Business & Commercial Law
  • Employment, Labor & Human Rights
  • Public, Criminal & International Governance
  • Private Law
• You have significant experience using large language models (LLMs) and understand how and why people use them
• You have excellent writing skills and can clearly explain complex legal concepts
• You are comfortable evaluating complex arguments and identifying subtle reasoning or detail-level issues that others may overlook

• Prior experience with RLHF, model evaluation, or data annotation work
• Experience writing or editing high-quality legal or analytical content
• Experience translating legal concepts for non-legal audiences
• Familiarity with evaluation rubrics, benchmarks, or quality scoring systems

• You uncover legal inaccuracies, misleading reasoning, or unclear explanations in model outputs
• Your evaluations improve the reliability and clarity of legal AI responses
• You deliver structured, reproducible feedback that meaningfully improves model performance
• Mercor customers trust their AI systems in legal contexts because you’ve rigorously evaluated them

Mercor offers legal professionals the opportunity to apply their expertise beyond traditional practice, shaping how AI systems reason about and communicate legal information. This flexible, remote role allows you to contribute directly to the future of legal AI while working on intellectually rigorous, high-impact projects.