Remote Legal Expert - AI Trainer

Location:

USA, EU, UK, Canada. Type:
Full-time or Part-time Contract Work. Fluent Language

Skills Required:

English.

Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general‑purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. In legal contexts, precision, clarity, and correct reasoning are critical. This project focuses on evaluating and improving conversational AI behavior when responding to legal questions, explanations, and analyses.

Your expertise helps ensure model responses reflect accurate legal understanding, appropriate reasoning, and responsible communication aligned with real‑world legal practice.

• Write and refine prompts to guide model behavior in legal use cases.
• Evaluate LLM‑generated responses to legal queries for accuracy, reasoning, clarity, and completeness.
• Conduct fact‑checking using trusted public sources and authoritative references.
• Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
• Assess tone, completeness, and appropriateness of responses for real‑world legal scenarios.
• Ensure model responses align with expected conversational behavior and system guidelines.
• Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

• Minimum of 5 years of real‑world professional experience in law, supported by an associated expert degree (e.g., JD, LLB, LLM, or equivalent).
• Experience in one or more sub‑domains:
  Corporate, Business & Commercial Law;
  Employment, Labor & Human Rights;
  Public, Criminal & International Governance;
  Private Law.
• Significant experience using LLMs and understand how and why people use them.
• Excellent writing skills and can clearly explain complex legal concepts.
• Comfortable evaluating complex arguments and identifying subtle reasoning or detail‑level issues that others may overlook.

• Prior experience with RLHF, model evaluation, or data annotation work.
• Experience writing or editing high‑quality legal or analytical content.
• Experience translating legal concepts for non‑legal audiences.
• Familiarity with evaluation rubrics, benchmarks, or quality scoring systems.

• Uncover legal inaccuracies, misleading reasoning, or unclear explanations in model outputs.
• Improve the reliability and clarity of legal AI responses through evaluations.
• Deliver structured, reproducible feedback that meaningfully improves model performance.
• Help Mercor customers trust their AI systems in legal contexts through rigorous evaluation.

Mercor offers legal professionals the opportunity to apply their expertise beyond traditional practice, shaping how AI systems reason about and communicate legal information. This flexible, remote role allows you to contribute directly to the future of legal AI while working on intellectually rigorous, high‑impact projects.