More jobs:
Remote | Member of Technical Staff, Legal Research
Remote / Online - Candidates ideally in
San Antonio, Bexar County, Texas, 78208, USA
Listed on 2026-10-02
San Antonio, Bexar County, Texas, 78208, USA
Listing for:
24-MAG
Full Time, Remote/Work from Home
position Listed on 2026-10-02
Job specializations:
-
Law/Legal
AI Evaluation -
Research/Development
AI Evaluation
Job Description & How to Apply Below
We are sharing a full-time opportunity for experienced legal researchers and legal professionals with deep expertise in legal analysis, research methodology, benchmarking, and complex legal workloads to contribute to advanced AI research and evaluation initiatives.
Selected professionals will design rigorous evaluation frameworks for legal AI systems, conduct applied research on legal reasoning and interpretation, develop realistic benchmark environments, and collaborate with researchers and engineers to assess and improve AI performance across sophisticated legal tasks.
Key ResponsibilitiesLegal AI Evaluation Frameworks
- Design and own evaluation frameworks for AI systems operating in legal domains
- Develop benchmark suites, scoring methodologies, and legal-quality rubrics
- Establish research-grade protocols for evaluating complex legal tasks
- Define consistent standards for assessing legal reasoning and analytical quality
- Evolve evaluation methodologies as legal AI capabilities advance
- Conduct applied research on legal reasoning and statutory interpretation
- Analyse legal arguments, authorities, and structured decision-making processes
- Research complex questions across relevant areas of law
- Develop methodologies for assessing legal outcomes and research quality
- Translate sophisticated legal concepts into structured evaluation criteria
- Develop and curate datasets reflecting realistic legal challenges
- Create case studies and benchmark environments for legal AI evaluation
- Design tasks involving legal research, analysis, and workflow execution
- Support evaluation of agentic legal workflows and automation
- Maintain benchmark quality, consistency, and practical relevance
- Evaluate legal-focused AI models and agentic systems
- Analyse reasoning quality, output reliability, and recurring failure modes
- Identify weak interpretations, unsupported conclusions, and methodological errors
- Assess AI performance across different legal use cases
- Provide structured findings to support model and evaluation improvements
- Collaborate with legal researchers, engineers, and interdisciplinary teams
- Produce research findings, evaluation methodologies, and best-practice guidance
- Monitor developments in legal technology, jurisprudence, regulation, and AI research
- Contribute to legal benchmarking and knowledge-management standards
- Help establish rigorous practices for evaluating AI-supported legal workflows
- Advanced degree in Law, such as JD, LLM, SJD, PhD in Law, or equivalent
- Deep expertise in one or more substantive legal domains
- Relevant areas may include corporate law, contracts, litigation, regulatory compliance, intellectual property, employment law, or public policy
- Demonstrated experience conducting legal research, legal analysis, or policy work
- Strong understanding of legal reasoning and research methodology
- Experience developing structured approaches for assessing legal arguments or outcomes
- Strong analytical reasoning and written communication skills
- Ability to translate legal expertise into rigorous evaluation criteria
- Experience working with interdisciplinary research, technology, or legal-operations teams
- Familiarity with legal technology or AI-enabled legal workflows is advantageous
- Background in legal benchmarking or legal knowledge management is beneficial
- Published legal scholarship or policy research is valuable
- Contributions to legal standards, frameworks, or research methodologies are advantageous
- Full-time engagement
- Fully remote
- Compensation: $400,000--$800,000/year
- The source materials contain a substantial compensation inconsistency, so final compensation terms should be confirmed…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×