RAG Context Quality Specialist

Globik AI is seeking RAG Context Quality Specialists to evaluate whether the context supplied to a language model is clear, useful, complete, and appropriate for answer generation.

You will inspect retrieved context and determine whether it provides the right information in a usable form, identifying noise, redundancy, missing context, and conflicting information.

• Review context supplied to AI models before answer generation.
• Assess whether the context contains useful information for the query.
• Identify irrelevant or noisy passages.
• Identify missing information and insufficient context.
• Flag duplicated or conflicting source content.
• Evaluate whether context is organized and understandable when required.
• Categorize context-quality issues.
• Document difficult cases and provide structured feedback.
• Maintain consistent evaluation quality across large datasets.

• Experience with RAG search information retrieval research content QA or AI evaluation is a plus.

• Follow project-specific RAG evaluation rubrics precisely.
• Clearly document difficult or ambiguous cases.
• Participate in calibration exercises when required.
• Regular quality reviews may be conducted throughout the project.
• Selected candidates may be required to complete a practical RAG assessment before onboarding.
• A reliable internet connection and computer are required.

$12–$18/task

Apply by .