German - Voice AI Evaluator

What if your voice could help teach AI how to handle a real phone call to a doctor's office? We're looking for native German speakers to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action.

You'll role-play as a patient (using fictional personas we provide), record short conversations, and grade the AI's performance. This is a fully remote, flexible contract role for people with clear speech, sharp attention to detail, and an ear for what sounds natural.

• Organization
  :
  Alignerr
• Type
  :
  Contract (task-based)
• Location
  :
  Remote
• Commitment
  :
  Flexible, work at your own pace

• Hold 4 to 5 minute spoken conversations in German with an AI front desk assistant, playing a fictional patient
• Say natural "trigger phrases" to test whether the AI makes the correct function calls (for example, checking a patient record, booking an appointment, or checking insurance)
• Review transcripts and classify how accurately the AI understood you and responded
• Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps
• Test how the AI handles background noise, short replies ("ja," "nein," "okay"), long numbers, emotional moments, and sensitive or unsafe requests
• Follow detailed labeling guidelines consistently and submit high-quality work

• Native or near-native German speaker with a clear, natural speaking voice
• Detail-oriented, with the patience to review recordings and transcripts closely
• Comfortable role-playing a patient and sounding authentic
• Able to follow multi-step instructions and apply them consistently
• Reliable and self-directed when working independently
• Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise
• Comfortable using web-based tools

• Experience in voice AI evaluation, data annotation, or QA testing
• Background in healthcare administration, customer service, or call center work
• Familiarity with spoken German variants (Germany, Austria, Switzerland) and colloquial speech
• Linguistics or language-focused studies
• Familiarity with medical terminology in German

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible
• Task-based work with real autonomy
• Directly help make voice AI more accurate, natural, and safe in healthcare settings
• Potential for ongoing work as new projects launch

Note:

New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.