Skip to content
×

Expert Talent Pool, Evals and Benchmarks; Associate

Listing for: Clera
Full Time position Listed on 2026-11-17
Job specializations:
Salary/Wage Range or Industry Benchmark: 30 - 60 USD Hourly USD 30.00 60.00 HOUR

Job Description & How to Apply Below

Position: Expert Talent Pool, Evals and Benchmarks (Associate)
Responsibilities
  • Write questions and tasks that isolate and test specific model capabilities
  • Develop rubrics defining strong, partial, and poor answers
  • Create reference answers and edge cases to challenge AI models
  • Grade model outputs against rubrics and explain scoring decisions
  • Analyze failed answers, group error patterns, and document findings
  • Compare multiple models using identical prompts
  • Validate benchmarks and flag compromised or ineffective questions
  • Participate in small user studies evaluating model outputs
Requirements
  • Zero to five years of professional experience
  • QA, test engineering, assessment design, or ML evaluation experience
  • Experience writing test cases, exam questions, or rubrics
  • Comfort using spreadsheets or Python to analyze results
  • Clear written communication
Preferred Qualifications
  • Experience with evaluation tools such as Inspect, lm-eval-harness, HELM, or promptfoo
Benefits
  • Compensation of $30 to $60 per hour, depending on project, field, and experience
  • Payment for hours worked
  • Fully remote; projects typically last one week to several months

Position Requirements

10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary