LLM Evaluation Engineer: Benchmark & Infra Lead
Listed on 2026-11-05
-
Research/Development
AI Evaluation -
Engineering
AI Evaluation
Nous Research is seeking a highly autonomous engineer to work across the lab on agent capability evaluations, benchmark design, LLM-as-judge systems, and failure analysis. You will own evaluation infrastructure used by researchers from day one, running end-to-end pipelines and documenting calibration processes.
You will extend existing benchmarks, perform failure analyses, and ship recurring eval workflows and dashboards.
We are seeking a motivated LLM Evaluation Engineer:
Benchmark & Infra Lead to join Nous Research in United States.
Learn more about the LLM Evaluation Engineer:
Benchmark & Infra Lead role in the description above.
We appreciate your interest in this position.
Join Nous Research and contribute to our ongoing work.
Take a moment to read everything above and see whether this role is right for you.
This posting is for the LLM Evaluation Engineer:
Benchmark & Infra Lead role at Nous Research, based in United States.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).