Conversation Quality Analyst

What if your instinct for natural conversation could directly improve how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human, helpful, and clear.

This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp sense for how conversation should flow. No AI, linguistics, or technical background required — if you can tell when a conversation feels off, you're already qualified.

• Organization:
  Alignerr
• Type:
  Hourly Contract
• Location:
  
  Remote
• Commitment: 10–40 hours/week

• Read and evaluate AI-generated conversations across a wide range of topics and scenarios
• Rate responses for naturalness, helpfulness, tone, and contextual relevance
• Identify awkward phrasing, logical inconsistencies, or responses that miss the mark
• Compare multiple conversation paths and rank them by overall quality
• Provide structured, detailed feedback using clear evaluation rubrics
• Work independently and asynchronously on your own schedule

• Strong reading comprehension and a natural feel for how conversations flow
• Ability to assess dialogue quality objectively and explain your reasoning clearly
• Detail-oriented and consistent — you apply the same standards across every evaluation
• Comfortable working through large volumes of text-based content
• Self-motivated and reliable when working independently
• No prior AI, linguistics, or quality assurance experience required

• Background in writing, editing, communications, or customer-facing roles
• Experience with content review, quality assurance, or critical analysis
• Familiarity with AI chatbots or conversational tools as an end user

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute to AI development that directly shapes how technology communicates with the world
• Potential for ongoing work and contract extension as new projects launch