Personal Account Generalist Raters

Freelancing Opportunity:
Personal Account Generalist Raters (Mobile)
Eligible

Location:

USA (Country-specific guidelines apply) - Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Texas, Virginia, Wisconsin, Wyoming.

Role:
Personal Account Generalist Rater (Mobile) - AI Evaluation

Experience:

No prior experience required

Mode:
Remote

Employment Type:

Contractor assignment (no medical benefits or paid leave)
Commitment:
Full-time (40 hours per week) or Part-time (20 hours per week)

Working Hours:

Minimum 4 hours of overlap with PST working hours

Pay Rate: $18/hour Mandatory Eligibility Criteria:

Technical and Device Requirements:

• Must own and use a primary Google Pixel 8 or newer device.
• Must have Android 17 or higher.
• Must be a regular user of the Google Messages app for personal SMS/RCS conversations.
• Must be comfortable reviewing AI-generated content in English.
• Ability to assess AI-generated responses for relevance, accuracy, helpfulness, and personalization.
• Strong attention to detail and the ability to provide consistent, objective ratings and feedback.
• Ability to follow detailed project guidelines and evaluation criteria.

Role Responsibilities:

• Review AI-generated prompts and responses in English.
• Evaluate responses for accuracy, relevance, helpfulness, and personalization.
• Review selected data from Google Workspace (G-Suite) applications, Google Messages, and device SMS content as part of the evaluation process.
• Assess how effectively AI understands everyday context, personal preferences, relationships, routines, and experiences.
• Provide clear ratings, explanations, and structured feedback.
• Follow project guidelines to ensure consistency and quality in evaluations.
• Contribute to improving the accuracy, relevance, and reliability of next-generation AI systems.

Availability Requirements:

• Full-time commitment of 40 hours per week or part-time commitment of 20 hours per week.
• Minimum 4 hours of overlap with PST working hours.
• Ability to commit to the project for the full 16-week engagement.

What You’ll Work On:

• Evaluate AI-generated responses based on personal context and user-specific information.
• Assess how accurately AI interprets contextual information and generates relevant, personalized responses.
• Identify errors, inconsistencies, and gaps in AI-generated outputs.
• Review selected personal data from supported applications to assess the quality of AI personalization.
• Provide structured feedback to help improve AI performance.
• Support the development and evaluation of more context-aware AI systems.

Perks of Freelancing

• Fully remote work opportunity.
• Flexible full-time or part-time engagement options.
• Competitive rate of $25 per hour, subject to the project's AHT cap.
• Opportunity to contribute to an AI evaluation project focused on personalization and contextual reasoning.
• Gain hands-on experience in AI response evaluation and quality assessment.
• Short-term contract engagement of 16 weeks.

About Turing

Turing's mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing partners with frontier AI labs to generate high-quality data, evaluations, and reinforcement learning environments that improve AI capabilities in coding, reasoning, tool use, and multimodality. Turing also works with Fortune 500 enterprises to build and deploy AI systems across critical business workflows.