Language Model Evaluation Specialist Remote

Location: Quebec

Elevate AI performance as a Language Model Evaluation Specialist with Mercor. This remote role focuses on quality assurance for AI technologies in both English and Punjabi.

Mercor, connecting top talent with AI labs, seeks candidates for this contract position requiring native Punjabi skills and strong English writing abilities. You will evaluate language model outputs, provide valuable feedback on factual accuracy, and improve AI conversational behaviors. Your expertise will drive enhancements in language processing models while ensuring deadlines are met independently.

Key Responsibilities:

• Evaluate AI responses for factual accuracy and clarity

• Generate detailed feedback on model performance

• Assess tone and completeness in responses

• Align outputs with expected conversational behaviors

• Maintain independence in managing evaluation tasks

Requirements:

• Bachelor's degree in relevant discipline

• Fluency in Punjabi and excellent English writing skills

• Significant experience with large language models

• Strong detail orientation and analytical thinking

• Prior experience in evaluation or data annotation preferred

Enhance AI language capabilities with your expertise in model evaluation at Mercor.
#J-18808-Ljbffr