Generalist Language Model Evaluator: Remote

Position: Generalist Language Model Evaluator: Remote Role
Become a Language Model Evaluator with Mercor, engaging with remote work as a contract Generalist. Focus on English and Punjabi to enhance AI language capabilities.

Mercor is looking for a detail-oriented evaluator for its language models. This role requires expertise in both Punjabi and English, bringing valuable experience with large language models. Your task will include generating and analyzing evaluation data to ensure the quality and factual accuracy of AI model responses, conducted independently and asynchronously.

Key Responsibilities:

• Conduct thorough fact-checking using vetted sources

• Assess strengths and weaknesses in AI responses

• Monitor clarity, reason quality, and tone of outputs

• Ensure responses meet set guidelines for conversation

• Collaborate asynchronously to refine AI performance

Requirements:

• Bachelor's degree in a relevant discipline

• Native proficiency in Punjabi and strong English skills

• Significant experience with large language models

• Exceptional attention to detail mandatory

• Experience in analytical domains appreciated

Shape the future of AI with your evaluation skills at Mercor as they advance language technology.
#J-18808-Ljbffr