GitHub Contributor AI Code Evaluation

About Open Train

Open Train AI is the hiring and contracting organization for this role. Open Train is the #1 platform for finding and building careers in AI training and data labeling, helping people discover projects, build their profiles, and apply in minutes.

This is a contractor opportunity for an expert software engineer who wants to apply practical coding knowledge to the development of next-generation AI systems. Previous AI experience is not required.

AI training is the human side of building artificial intelligence. Engineers and other specialists provide examples, evaluations, and feedback that help AI models learn how to reason, solve problems, and produce more useful results.

In this role, your software engineering expertise will help create realistic challenges and high-quality reference solutions for evaluating AI performance on complex coding tasks.

Open Train AI is seeking expert Senior Software Engineers to create Reinforcement Learning environments that test an AI model's ability to solve software engineering problems. You will build reproducible environments and golden reference solutions for tasks involving code fixes, feature development, refactoring, and performance optimization.

The expected commitment is under 20 hours per week, with a project duration of approximately 1 to 3 months. Work is remote, conducted in English, and limited to candidates based in the listed countries.

• Role type:
  Contractor and part-time
• Expected commitment:
  Less than 20 hours per week
• Project duration:
  Approximately 1 to 3 months
• Compensation: $50-$150 per hour, output-based per task
• Work language:
  
  English
• Eligible locations:
  United States, Canada, United Kingdom, Australia, New Zealand, Switzerland, Germany, Mexico, and India

You will contribute expert-level code, debugging approaches, and technical reasoning that can be used to create reliable AI training and evaluation data. Assignments may span multiple programming languages and diverse codebases.

• Create Reinforcement Learning environments for complex software engineering challenges.
• Develop reproducible environments and golden reference solutions.
• Provide code samples, debugging strategies, and development insights in Python 3, Java, Rust, Go, C++, or Type Script.
• Analyze and resolve complex software defects and performance bottlenecks.
• Implement robust features with attention to scalability, maintainability, and software engineering best practices.
• Refactor and optimize legacy code to improve clarity, efficiency, and reliability.
  
  Document technical reasoning, solution approaches, and code decisions.
• Review and validate peer-contributed code and technical submissions for accuracy and clarity.

This is an expert-level opportunity for candidates with strong hands-on software engineering and code evaluation experience. Applicants must have clear open-source contributions and a profile that demonstrates their work, such as Git Hub or Git Lab.

• Significant expertise in at least one of Python 3, Java, Rust, Go, C++, or Type Script.
• Strong understanding of algorithms, data structures, and software engineering principles.
• Proven ability to debug complex systems, resolve bugs, and deliver effective optimizations.
• Experience refactoring large codebases and modernizing legacy systems.
• A track record of delivering high-impact features from conception through delivery.
• Strong technical documentation and communication skills.
• Software engineering AI training and code evaluation subject matter expertise.
• Native or bilingual English proficiency.
• A clear Git Hub or Git Lab profile with open-source contributions is required.

Compensation is output-based. Experts are paid per task that meets project specifications, and the time required may vary based on experience and workflow. Minimum submission requirements apply.

Open Train AI typically fills roles within 48 hours and is seeking experts who can begin promptly. If selected, you are expected to start your first tasks within 24 to 48 hours after completing onboarding.

• Compensation range: $50-$150 per hour
• Payment structure:
  Output-based per completed task
• Expected start:
  Within 24 to 48 hours after onboarding