Software Engineer; Code QA

Overview

Mercor is hiring experienced Software Engineers to support high-impact research collaborations with leading AI labs. Freelancers will contribute to building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.

This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems.

This evaluation dataset is code question and answer data. This data is designed to assess natural-language reasoning, explanation quality, and technical judgment in coding-related interactions, rather than executable correctness. Tasks are structured as chat-pasteable prompts that reflect realistic developer questions and include all necessary context inline (e.g., code snippets, error messages, logs, or requirements)

• Craft realistic developer prompts across multiple categories (code review, debugging, error diagnosis, configuration, and more)
• Source and adapt content from real PRs to create authentic scenarios
• Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality

• 2+ years of experience in software engineering, technical research, or educational content development
• Degree in Software Engineering, Computer Science, or a related field (Bachelor’s minimum; advanced degree preferred)
• Strong proficiency in languages like Python, JavaScript, Java, or C++
• Experience with debugging, testing, and validating code
• Comfortable with technical writing and attention to detail

• Start Date: Immediate
• Duration: 1-2 months
• Commitment: Part-time (15–25 hours/week, with flexibility up to 40 hours/week)

Apply today and leverage your software engineering expertise to help build the future of AI-driven systems!

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note:
  
  We are unable to support H1-B or STEM OPT candidates at this time.

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.

• 🇬🇧 United Kingdom
• 🇺🇸 United States
• 🇨🇦 Canada
• 🇦🇺 Australia
• 🇳🇿 New Zealand
• 🇦🇹 Austria
• 🇧🇪 Belgium
• 🇫🇷 France
• 🇩🇪 Germany
• 🇱🇮 Liechtenstein
• 🇱🇺 Luxembourg
• 🇲🇨 Monaco
• 🇳🇱 Netherlands
• 🇨🇭 Switzerland
• 🇧🇬 Bulgaria
• 🇨🇿 Czech Republic
• 🇭🇺 Hungary
• 🇲🇩 Moldova
• 🇵🇱 Poland
• 🇷🇴 Romania
• 🇸🇰 Slovakia