Bilingual Language Quality Analyst | Remote

Type: Hourly contract

Compensation: $18.14/hour

Location: Remote

Commitment: 10–40 hours/week

• Evaluate LLM-generated responses for accuracy, relevance, and usefulness across diverse topics.
• Conduct fact-checking using trusted public sources and external tools.
• Generate high-quality human feedback by annotating strengths, weaknesses, and factual errors in model responses.
• Assess reasoning quality, clarity, tone, and completeness of AI outputs.
• Ensure responses align with expected conversational behavior and system guidelines.
• Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks.

• Native-level or near-native fluency in Spanish (ILR 5 / CEFR C2) and strong English proficiency.
• Demonstrated experience using large language models and understanding real-world LLM use cases.
• Excellent writing skills with the ability to provide clear, nuanced feedback.
• Strong attention to detail and analytical thinking skills.
• Ability to work across multiple topics, domains, and evaluation criteria.
• Background in structured analytical domains such as research, policy, analytics, linguistics, or engineering.