More jobs:
English Audio Rater
Job in
San Jose, Santa Clara County, California, 95199, USA
Listed on 2026-10-09
Listing for:
Welo Data
Full Time
position Listed on 2026-10-09
Job specializations:
-
Science
AI Evaluation, Data Annotation/ AI Labeling
Job Description & How to Apply Below
Overview
We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.
Project DetailsStart Date: ASAP
Duration: 10 hours/week
Job Type: Freelance
Location: Remote (
United States
)
Language: English(United States)
Pay Rate: US $26.33/hour
What You’ll Do- Listen carefully to recorded conversations between a person and an AI voice agent
- Rate each of the agent's turns on two independent 1–5 scales:
- Content – Was the response helpful, relevant, and appropriate?
- Prosody – Did the voice sound natural, well‑paced, and expressive?
- Write a short, specific, and clear justification for each score given
- Strong listening and attention-to-detail skills
- Ability to give consistent, well-reasoned ratings
- Clear, concise written communication
- Reliable availability for ~10 hours/week
Thank you for your interest in joining Welo Data’s community and contributing to this exciting project. We look forward to collaborating with you!
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×