Business Analyst; Computer Use Agent; II

Review AI responses and validate information through detailed analysis.

About Turing:
Turing’s mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality data, evaluations, and reinforcement learning environments that improve model capabilities in coding, reasoning, tool use, and multimodality. In coding, Turing is the largest and longest-running data provider in the category.

The Business Analyst works on a Computer-Using Agent (CUA) evaluation project designed to assess and improve how AI systems understand instructions, analyze information, reason through problems, and complete tasks in digital environments. The role involves reviewing AI-generated responses and actions, validating information through online research, assessing accuracy and task completion, identifying errors or gaps, and providing detailed annotations, ratings, and explanations

• Analyze, summarize, and structure complex written content clearly and accurately.
• Conduct online research to verify claims, sources, and supporting evidence.
• Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
• Create scenarios and questions to evaluate and improve large language model performance.
• Review AI-generated responses and provide detailed ratings, annotations, explanations, and feedback.

• Demonstrate excellent English communication and reading comprehension skills.
• Apply analytical, logical, critical, and creative thinking to solve complex problems.
• Identify reliable information and distinguish it from inaccurate or unsupported claims.
• Interpret data, identify patterns, compare information, and perform basic calculations.
• Work independently while following detailed instructions, quality standards, and timelines.

• Hold or pursue a degree in Engineering, Literature, Journalism, Communications, Arts, Statistics, Business, or a related field.
• Demonstrate relevant experience in business analysis, research, copywriting, journalism, technical writing, editing, translation, or similar fields.
• Candidates without a bachelor’s degree may also be considered based on relevant experience and demonstrated skills.
• Demonstrate familiarity with Excel, Google Sheets, Google Docs, and Google Workspace.
• Show an interest in artificial intelligence, large language models, online research, and emerging technologies.

• Engagement Type:
  Hourly, long-term engagement.
• Duration: 16 weeks, with potential opportunities for extension.
• Expected
  
  Start Date:
  
  Around 15 October or nearby dates.

Business Analysis