Business Analyst; Computer Use Agents Turing Turing · Varies · remote · 4d ago Varies 4d ago

Business Analyst (Computer Use Agents) | Remote | Hourly contract, 16 weeks

You'll work on Turing's Computer-Using Agent (CUA) evaluation project, which assesses how AI systems understand instructions, analyze information, reason through problems, and complete tasks in digital environments. The role involves reviewing AI-generated responses and actions, validating information through online research, assessing accuracy and task completion, identifying errors or gaps, and providing detailed annotations, ratings, and explanations. Turing is a San Francisco-based company that works with frontier AI labs on data, evaluations, and reinforcement learning environments.

• Analyze, summarize, and structure complex written content clearly and accurately.
• Conduct online research to verify claims, sources, and supporting evidence.
• Solve analytical, logical reasoning, data interpretation, arithmetic, and puzzle-based questions.
• Create scenarios and questions to evaluate and improve large language model performance.
• Review AI-generated responses and provide detailed ratings, annotations, explanations, and feedback.

• Excellent English communication and reading comprehension skills.
• Analytical, logical, critical, and creative thinking to solve complex problems.
• Ability to identify reliable information and distinguish it from inaccurate or unsupported claims.
• Ability to interpret data, identify patterns, compare information, and perform basic calculations.
• Ability to work independently while following detailed instructions, quality standards, and timelines.

• Degree (held or in progress) in Engineering, Literature, Journalism, Communications, Arts, Statistics, Business, or a related field.
• Experience in business analysis, research, copywriting, journalism, technical writing, editing, translation, or similar fields.
• Candidates without a bachelor's degree may be considered based on relevant experience and demonstrated skills.
• Familiarity with Excel, Google Sheets, Google Docs, and Google Workspace.
• Interest in artificial intelligence, large language models, online research, and emerging technologies.

• Hourly, long-term engagement.
• Duration: 16 weeks, with potential opportunities for extension.
• Expected start date: around 15 October.

The selection process includes an online assessment of about 45-50 minutes, to be completed on a desktop or laptop. Candidates who pass the internal assessment review will be considered for the role.