Skip to content
×

AI Benchmark Task Auditor & Quality Reviewer

Listing for: Parailabs
Full Time position Listed on 2026-11-19
Job specializations:
Salary/Wage Range or Industry Benchmark: 120000 - 180000 USD Yearly USD 120000.00 180000.00 YEAR

Job Description & How to Apply Below

Parailabs is seeking a software engineering specialist to evaluate the quality and reproducibility of benchmark tasks used to train and evaluate frontier AI models. The role involves auditing reference patches, test runners, and Docker isolation, and delivering rubric-based feedback on repository-level tasks and grading integrity.

The ideal candidate has strong Python skills, open-source contributions, and experience auditing test harnesses and reward systems in AI benchmarks.

We have an opening for a AI Benchmark Task Auditor & Quality Reviewer in United States within Finance, IT & Technology.

The position is based in United States.

This opportunity is part of our work in Finance, IT & Technology.

The advertised compensation is 120..

We aim to respond to suitable candidates as soon as possible.

Full responsibilities and requirements are described in the listing above.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary