Computer Science Expert Python Validation
Listed on 2026-10-29
-
IT/Tech
AI Evaluation
Use Python to validate AI-generated computer science solutions, assess multi-step reasoning, and design rigorous problems. This project-based expert role pays $15-$40 per hour and is open worldwide.
100% Remote Hourly · $15–$40/hr
$15–$40/hr
Compensation
Contract, part-time
Engagement
Remote
Location
Apr 5, 2026
Posted
The workYou will create challenging computer science problems based on real professional practice and evaluate AI-generated solutions. Your reviews will focus on correctness, logical soundness, assumptions, constraints, edge cases, and the quality of multi-step reasoning.
You will also use Python to check calculations and simulations, improve explanations so they follow industry-standard logic, and apply consistent scoring criteria. The work may include evaluation, question answering, text generation, coding review, and red teaming.
- Design rigorous computer science problems for AI evaluation.
- Validate calculations and simulations with Python tools such as Num Py, Pandas, and Sci Py.
- Score complex solutions using structured evaluation criteria.
- Assess assumptions, constraints, edge cases, correctness, and reasoning quality.
- Improve AI-generated reasoning and explanations to meet professional standards.
- Help maintain consistent evaluation standards with other advanced experts.
This is a project-based contractor role for an expert contributor. The work is not permanent, and availability is needed during active project phases.
- Pay: $15-$40 per hour, with the listed rate up to $40 per hour.
- Language:
Fluent written English at C1+ level or equivalent. - Availability:
About 10-20 hours per week during active project phases; the listing also records a 20+ hour weekly requirement. - Education:
A degree in Computer Science or a closely related field, or equivalent demonstrated expertise. - Experience:
At least 2 years of applied, research, or teaching experience in computer science or a related technical field. - Technical skill:
Strong Python proficiency for numerical validation and simulation. - Evaluation skill:
Ability to assess multi-step solutions for correctness, assumptions, constraints, and edge cases. - Additional tools such as MATLAB, R, C, C++, SQL, or related libraries are a plus.
- Professional certifications such as SAS or CAP, and international or applied project experience, are a plus.
AI training work uses human judgment to create, review, and improve the examples that AI systems learn from. Open Train AI is the hiring and contracting organization for this role, connecting qualified contributors with project work that helps improve AI systems.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).