AI Evaluation Engineer: LLM Judging & Calibration
Listed on 2026-11-04
-
IT/Tech
AI Evaluation, AI Engineer (Applied/Software)
Coval is seeking a seasoned ML engineer to design and run evaluation pipelines for scoring voice and chat conversations. You will define metrics, build trusted evaluation systems, and run end-to-end fine-tuning experiments with curated data.
The role rewards clear judgment on what boosts quality and emphasizes calibration against human raters. You will gain hands-on experience with LLM judge design, dataset preparation, and stress testing conversational agents before deployment, aligning with
We are seeking a motivated AI Evaluation Engineer: LLM Judging & Calibration to join present of AI in San Francisco, CA, United States.
Join present of AI and contribute to our ongoing work.
Take a moment to read everything above and see whether this role is right for you.
This posting is for the AI Evaluation Engineer: LLM Judging & Calibration role at present of AI, based in San Francisco, CA, United States.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).