Python AI Code Evaluator

Python expertise anchors this flexible United States contractor engagement with Turing, focused on evaluating AI-generated code. Build reliable datasets and verification tools.
As a Software Engineering evaluator, you will create datasets for training, benchmarking, and advancing large language models. The work emphasizes Python across backend services, data pipelines, and machine learning infrastructure. You will also assess code written in JavaScript, ReactJS, C/C++, Java, Rust, and Go.

Key Responsibilities:

Curate code examples for artificial intelligence model training
Provide precise solutions and correct software code
Evaluate generated code for efficiency, scalability, and reliability
Build Python agents and automated verification tools
Design mechanisms verifying software engineering task solutions
Requirements:
Three or more years of software engineering experience
Strong Python expertise, frameworks, tooling, and best practices
Full-stack application development and scalable software deployment experience
Understanding of architecture, development, debugging, and code quality
Clear oral and written communication for evaluation rationales
Apply production-grade Python, full-stack development, and code evaluation skills to advance Turing’s large language model systems.