AI Coding Model Evaluation Engineer
Job in
Montreal, Montréal, Province de Québec, G4F, Canada
Listed on 2026-10-30
Listing for:
Turing Enterprises, Inc.
Full Time
position Listed on 2026-10-30
Job specializations:
-
Software Development
AI QA / Validation Engineer, AI Engineer (Applied/Software), Python, Software Testing
Job Description & How to Apply Below
Evaluate AI-generated code with Python or Type Script expertise as an independent contractor supporting Turing’s model improvement work.
This experienced software engineering role focuses on reviewing coding agents across real-world repositories. You will assess correctness, robustness, maintainability, and agent behavior, then create evaluation signals that improve coding models. The work includes collaboration with researchers and engineers.
Key Responsibilities:- Evaluate AI-generated code across real-world software repositories
- Review agent behavior, tool usage, and code changes
- Identify technical errors and recurring model failure modes
- Create rubrics and evaluation criteria for coding tasks
- Produce preference data and actionable findings
- Five or more years of software engineering experience
- Strong Python, Type Script, JavaScript, Go, or production language proficiency
- Experience with substantial real-world codebases
- Strong code-review skills and technical judgment
- Experience using modern LLMs or AI coding tools
Apply software engineering judgment, code review, and written communication to improve Turing’s AI coding models.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×