AI Trainer- Coding
Job in
Asheville, Buncombe County, North Carolina, 28801, USA
Listing for:
Aston Carter
Full Time
position
Listed on 2026-11-13
Job specializations:
-
Software Development
Job Description & How to Apply Below
- Git & Version Control
The Role
We are seeking a detail-oriented Software Engineering Evaluator to assess and improve the quality of AI-generated software development work. In this role, you will apply your engineering expertise to design realistic coding scenarios, evaluate AI-generated solutions, and provide structured feedback on code quality, correctness, and technical execution.
This opportunity is ideal for software engineers who enjoy reviewing code, solving technical problems, and applying strong engineering judgment to ensure high-quality, production-ready outcomes.
Key Responsibilities- Create realistic software engineering tasks based on real-world development workflows, including technical requirements, supporting documentation, test cases, and code repositories.
- Evaluate AI-generated code solutions against professional engineering standards for correctness, maintainability, performance, and reliability.
- Compare outputs from different AI systems using identical requirements and environments, documenting relative strengths and areas for improvement.
- Develop test plans, evaluation rubrics, and success criteria that clearly define expected functionality, coding standards, and edge-case handling.
- Review code changes, implementation decisions, automated tests, and design approaches to verify technical quality and adherence to requirements.
- Identify and document issues such as:
- Missed edge cases
- Incorrect or incomplete implementations
- Fragile code changes
- Ineffective testing strategies
- Requirements misinterpretation
- Unsupported assumptions or fabricated outputs
- Collaborate with engineers and reviewers to refine evaluation tasks, improve assessment methodologies, and maintain quality standards across projects.
- Contribute technical expertise across a variety of technologies, platforms, and software development environments.
- Experience developing, testing, and maintaining software applications or systems.
- Proficiency in at least one modern programming language such as:
- Python
- JavaScript / Type Script
- Java
- Go
- C++
- C#
- Ruby
- PHP
- Swift
- Kotlin
- Rust
- Strong understanding of software engineering principles, debugging techniques, testing methodologies, and version control systems.
- Ability to quickly understand unfamiliar codebases and evaluate implementation quality.
- Experience using tools such as Git, testing frameworks, command-line interfaces, and debugging tools.
- Excellent written communication skills with the ability to explain technical findings clearly and objectively.
- Professional-level English proficiency.
- Two or more years of software development experience in a professional, academic, freelance, or open-source setting.
- Familiarity with containerization, CI/CD pipelines, and modern development workflows.
- Experience using AI-powered coding assistants or large language model (LLM) tools such as ChatGPT, Claude, Git Hub Copilot, or similar technologies.
- Bachelor's degree (completed or in progress) in Computer Science, Software Engineering, Information Systems, or a related discipline, or equivalent practical experience.
- Consistently identifies technical issues, risks, and implementation gaps with supporting evidence.
- Demonstrates sound engineering judgment when evaluating code quality and software behavior.
- Produces clear, actionable feedback that improves the quality of AI-generated software outputs.
- Applies best practices in testing, maintainability, performance, and software design.
- Delivers objective and well-documented evaluations across multiple technologies and domains.
- Software Development
- Code Review
- Quality Assurance
- Test Design & Validation
- Debugging & Troubleshooting
- Git & Version Control
- Software…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction