Remote Health AI Chatbot Evaluator - Quick Tasks

Position: AI Chatbot Evaluator (Health & Wellness Study)

Project Type: Contractor Assignment

Location: Remote (U.S.)

Compensation: $180 flat fee - minimum of 4 tasks, $45 for any additional tasks completed

Time Commitment: ~2-3 hours total (including about 30 minutes for instructions/setup and 30 minutes for task completion)

Productive Playhouse is supporting a new upcoming project to evaluate the performance of leading AI chatbots on health and wellness topics. The objective of this study is to determine whether personalization improves response quality when users interact with these AI models. Participants will use their existing personal accounts and conversation history to engage with their preferred AI chatbot, such as Gemini, ChatGPT, or Claude.

The goal is to evaluate how effectively the chatbot uses user context to deliver high‑quality, meaningful, and personalized insights.

• Interact with your assigned AI model on designated health and wellness topics.
• Use your personal AI chatbot account and existing conversation history to evaluate personalized response quality.
• Assess how well the system adapts to your inputs and provides accurate, relevant responses.
• Address feedback and implement revisions to support high quality submissions.
• Complete a structured evaluation form based on your experience.

• Must be 18 years of age or older.
• Currently residing in the United States.
• Must be fully proficient in reading and writing instructions in English.
• Must have one of the following existing, active personal accounts:
  • A personal Google account to use Gemini, not newly created or a test account.
  • An active, paid ChatGPT subscription.
  • An active, paid Claude Pro subscription.
• The selected AI chatbot account must have at least 1 month of active usage history.
• As this project continues to evolve, we want to ensure we set clear expectations from the start. Given the iterative nature of this test, there will be times when we need to adapt and make adjustments along the way. We ask that you remain flexible and open to changes as they arise.

Apply now and check your email immediately to complete the mandatory Intake Form (where you will specify which AI platform you currently use). Once submitted, our project leads will review your application and contact qualified participants with setup instructions as soon as the project goes live.

Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees. Employment with Productive Playhouse is at‑will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice.

All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location. Productive Playhouse participates in E‑Verify.

Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities. If you need assistance or accommodation due to a disability, please contact the Human Resources Department.