AI Benchmark Architect: Craft Hard Problems to Stump Models
Listed on 2026-10-18
-
Research/Development
AI Evaluation -
IT/Tech
AI Evaluation, AI Engineer (Applied/Software)
Lifted, an Upwork Company, seeks a seasoned problem designer to build benchmarks of expert-level challenges that today’s best AI agents cannot solve. You will craft tasks from real-world expert domains and translate them into Linux-terminal challenges for evaluation.
The role focuses on designing robust benchmarks, ensuring models fail across multiple frontier AI systems, and delivering rigorous, publishable work. A strong technical background and proven research outputs are essential.
The following position is for a AI Benchmark Architect:
Craft Hard Problems to Stump Models with Lifted, an Upwork Company.
All applications are reviewed carefully by our team.
The position is based in Tallahassee, FL, United States.
This opportunity is part of our work in Bio & Pharmacology & Health, IT & Technology.
The advertised compensation is 90..
We aim to respond to suitable candidates as soon as possible.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).