More jobs:
AI Evaluation Architect - Project-Based Code Agent Testing
Job in
New York, New York County, New York, 10261, USA
Listed on 2026-08-08
Listing for:
Mindrift
Full Time
position Listed on 2026-08-08
Job specializations:
-
Software Development
Python
Job Description & How to Apply Below
Mindrift is building a dataset to evaluate AI coding agents by creating realistic developer environments, tasks, and tests. You will guide and evaluate the agent’s work, ensuring the tasks have valid multiple solutions and fair criteria.
This contract-based role offers up to $50/hr, with ~20 hours per task and flexible scheduling, requiring 5+ years in software development with a core stack including Python, FastAPI, React, Docker, Postgres, Kafka, Redis and testing experience.
#J-18808-LjbffrTo View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×