Conversation Quality Analyst

Conversation Quality Analyst (AI Training)

What if your instinct for natural conversation could directly influence how millions of people experience AI every day? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human — clear, helpful, and natural.

This is a fully remote, flexible contract role open to anyone with sharp language instincts and a critical eye. No AI, linguistics, or technical background required — just a strong feel for how good conversation works.

• Organization:
  Alignerr
• Type:
  Hourly Contract
• Location:
  
  Remote
• Commitment: 10–40 hours/week

• Read and evaluate AI-generated conversations across a wide range of topics and contexts
• Rate responses for naturalness, tone, helpfulness, and conversational flow
• Identify awkward phrasing, off-topic replies, logical inconsistencies, or robotic-sounding language
• Compare multiple conversation paths and rank them by overall quality
• Submit structured, detailed evaluations using provided rubrics and rating tools
• Work independently and asynchronously on your own schedule

• Strong reading comprehension and a natural sense for how conversation should flow
• Able to assess dialogue quality objectively and explain your reasoning clearly
• Detail-oriented and consistent — you apply the same standard across large volumes of work
• Self-motivated and reliable when working independently
• Comfortable working through high volumes of text-based tasks
• No prior AI, linguistics, or tech experience required

• Background in writing, editing, communications, or customer-facing roles
• Experience with quality assurance, content review, or critical analysis
• Familiarity with AI chatbots or conversational tools as an end user

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute to AI development that directly shapes how technology communicates with the world
• Potential for ongoing work and contract extension as new projects launch