More jobs:
Search Query–Result Relevance Specialist
Job in
Chicago, Cook County, Illinois, 60601, USA
Listing for:
Globik AI
Full Time
position
Listed on 2026-11-09
Job specializations:
-
IT/Tech
AI Evaluation, Data Annotation/ AI Labeling
Job Description & How to Apply Below
Globik AI is seeking Search Query–Result Relevance Specialists to evaluate whether search results genuinely match what users are looking for.
The role focuses on reviewing queries alongside returned results, judging relevance and usefulness, identifying weak or irrelevant results, and providing consistent ratings that help improve search systems.
Responsibilities- Review user search queries and returned search results.
- Determine whether each result directly addresses the user's intent.
- Rate results according to relevance, usefulness, freshness, and project criteria.
- Identify unrelated, partially relevant, misleading, duplicate, or low-quality results.
- Distinguish genuinely useful results from results that only share keywords with the query.
- Consider ambiguity and likely user expectations when making judgments.
- Apply project-specific relevance guidelines consistently.
- Document difficult or ambiguous cases and elevate them when required.
- Maintain accuracy across large evaluation batches.
- Participate in calibration and quality-review sessions.
- Strong reading comprehension and analytical judgment.
- Excellent attention to detail.
- Experience in search evaluation content review QA research or AI evaluation is a plus.
- Ability to understand search queries and determine user intent.
- Maintain high accuracy and consistency across assigned evaluation tasks.
- Follow project-specific search evaluation rubrics precisely.
- Participate in training and calibration exercises when required.
- Regular quality reviews may be conducted throughout the project.
$10–$16/task
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).