Python AI Evaluation Engineer

Python AI evaluation engineering for Turing supports preference data, rubric design, and quality-focused model development. This fully remote contract emphasizes clear technical judgment.
Turing seeks an engineer experienced with Python pipelines or Type Script codebases. You will shape evaluation criteria, review preference data, and turn technical findings into actionable communication. The work supports training data, evaluations, and engineering workflows for frontier AI labs.

Key Responsibilities:

Design and refine rubrics for preference data evaluation
Review and label data while catching subtle quality issues
Build pipelines supporting data generation and evaluation workflows
Synthesize findings into clear updates and recommendations
Translate qualitative judgment into scalable processes
Requirements:
Proficiency in Python for pipelines and infrastructure
Hands-on preference data collection or rubric creation experience
Strong written and verbal communication skills
Ability to articulate why work demonstrates high quality
Availability for remote contract collaboration
Use Python, evaluation judgment, and preference data experience to improve Turing’s AI development workflows remotely.