Skip to content
×

Search Query–Result Relevance Specialist

Job in Chicago, Cook County, Illinois, 60601, USA
Listing for: Globik AI
Full Time position Listed on 2026-11-09
Job specializations:
  • IT/Tech
    AI Evaluation, Data Annotation/ AI Labeling
Salary/Wage Range or Industry Benchmark: 14000 - 22000 USD Yearly USD 14000.00 22000.00 YEAR

Job Description & How to Apply Below

Globik AI is seeking Search Query–Result Relevance Specialists to evaluate whether search results genuinely match what users are looking for.

The role focuses on reviewing queries alongside returned results, judging relevance and usefulness, identifying weak or irrelevant results, and providing consistent ratings that help improve search systems.

Responsibilities
  • Review user search queries and returned search results.
  • Determine whether each result directly addresses the user's intent.
  • Rate results according to relevance, usefulness, freshness, and project criteria.
  • Identify unrelated, partially relevant, misleading, duplicate, or low-quality results.
  • Distinguish genuinely useful results from results that only share keywords with the query.
  • Consider ambiguity and likely user expectations when making judgments.
  • Apply project-specific relevance guidelines consistently.
  • Document difficult or ambiguous cases and elevate them when required.
  • Maintain accuracy across large evaluation batches.
  • Participate in calibration and quality-review sessions.
Qualifications
  • Strong reading comprehension and analytical judgment.
  • Excellent attention to detail.
  • Experience in search evaluation content review QA research or AI evaluation is a plus.
  • Ability to understand search queries and determine user intent.
  • Maintain high accuracy and consistency across assigned evaluation tasks.
  • Follow project-specific search evaluation rubrics precisely.
  • Participate in training and calibration exercises when required.
  • Regular quality reviews may be conducted throughout the project.
Pay

$10–$16/task

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).

Search for further Jobs Here:

10 MILLION+ Job Search Platform:
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary