More jobs:
Writer | Remote
Remote / Online - Candidates ideally in
Toronto, Ontario, C6A, Canada
Listed on 2026-10-06
Toronto, Ontario, C6A, Canada
Listing for:
Crossing Hurdles
Remote/Work from Home
position Listed on 2026-10-06
Job specializations:
-
IT/Tech
AI Evaluation, Data Annotation/ AI Labeling -
Research/Development
AI Evaluation, Data Annotation/ AI Labeling
Job Description & How to Apply Below
- Evaluate LLM-generated responses for accuracy, relevance, and effectiveness across a wide range of topics.
- Perform fact-checking using reliable public sources and external tools.
- Create high-quality human evaluation data by annotating response strengths, gaps, and factual errors.
- Assess reasoning quality, tone, clarity, and completeness of AI-generated outputs.
- Ensure responses follow expected conversational behavior and system guidelines.
- Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks.
- Native-level or near-native fluency in French (ILR 5 / CEFR C2) with strong English proficiency.
- Proven experience using large language models and understanding real-world LLM use cases.
- Excellent writing skills with the ability to provide clear, nuanced, and structured feedback.
- Strong attention to detail and analytical thinking.
- Ability to work across multiple topics, domains, and evolving requirements.
- Background in structured analytical fields such as research, policy, analytics, linguistics, or engineering.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×