AI Evaluator | Remote

Type: Contractor, Remote

Compensation: $15 - $30/hour

Location: Remote

Commitment: 10-40 hrs/week

• Complete realistic, everyday digital tasks using AI assistant tools under standardized conditions.
• Give an AI assistant clear instructions for real-world tasks and verify its work for accuracy.
• Apply grading guidelines to evaluate, rank, and annotate assistant responses.
• Test scenarios involving email threads, calendar invites, and multi-person coordination.
• Utilize AI training tools to record findings and submit evaluation data.
• Collaborate with project trainers to resolve ambiguities and refine guidelines.
• Participate in ongoing quality reviews to maintain rigorous evaluation standards.

• Daily, hands-on use of Gmail and Google Calendar for personal management tasks.
• Regular experience coordinating with others over email or text.
• Comfort booking things online independently, such as restaurants or travel.
• Experience using AI tools for practical tasks, with comfort giving instructions and checking work.
• Exceptional attention to detail and accuracy when reviewing AI-generated output.
• Strong written communication skills for clear reporting and updates.
• Demonstrated time management and self-organization for independent, remote project participation.