Data Science Expert - AI Evaluation
Job in
New Rochelle, Westchester County, New York, 10801, USA
Listing for:
Mercor
Full Time
position
Listed on 2026-11-21
Job specializations:
-
IT/Tech
Job Description & How to Apply Below
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark
, General Catalyst
, Peter Thiel
, Adam D'Angelo
, Larry Summers
, and Jack Dorsey
.
Position: Data Science Expert
Type:
Contract
Compensation: $120–$170/hour
Location:
Remote
Role Responsibilities
- Design precise, task‑specific grading criteria for real‑world data science deliverables such as analyses, models, dashboards, and experiment readouts.
- Score AI‑generated and human work samples against criteria with detailed written justifications for every score.
- Apply consistent, evidence‑based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Work independently and asynchronously to meet deadlines while improving AI model performance
.
Qualifications
Must‑Have
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top‑tier technology companies.
- Deep fluency in experiment design and A/B testing, metric definition,
SQL/Python analysis, and communicating findings to executive stakeholders. - Exceptionally strong written communication.
- Detail‑oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training
, evaluation, or human‑data projects.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to:
PS:
Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction