More jobs:
Benchmarking Systems Engineer for LLM Evaluation
Job in
Greater London, London, Greater London, W1B, England, UK
Listed on 2026-08-23
Listing for:
Callosum
Full Time
position Listed on 2026-08-23
Job specializations:
-
Business
AI Evaluation
Job Description & How to Apply Below
Callosum is seeking a PhD-level researcher to own and build a unified benchmarking system for multi-step LLM work. You will design task suites, run sandboxed grading with real commits and traces, and base decisions on reproducible results rather than model scores.
Lead external benchmark co-publications, enforce contamination controls, and drive open, scalable evaluation. This London-based, in-person role offers equity, private healthcare, visa sponsorship, and relocation support.
#J-18808-LjbffrNote that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×