Javanese Speakers — Contribute to AI LLM Evaluation

Overview

Join Project Spearmint — a multilingual AI response evaluation project focused on reviewing large language model (LLM) outputs in different languages.

• Review short, pre-segmented datasets.
• Evaluate model-generated replies based on Tone or Fluency.
• Read a user prompt and two model replies, then rate each using a five-point scale.
• Provide short rationales for extreme ratings.

• Batch 1 – Tone:
  Determine if replies are helpful, engaging, fair, and appropriately formal. Flag issues such as condescension, bias, or tonal mismatches.
• Batch 2 – Fluency:
  Assess grammatical accuracy, clarity, coherence, and natural flow.

• Native-level fluency in the Javanese language.
• Strong comprehension of English.
• Residing in Indonesia.
• Can commit to working 25 hours per week.

This is a project-based opportunity with Crowd Gen
. Payment details will be provided upon selection.

• Apply to Project Spearmint.
• If selected, you will receive an email from Crowd Gen to create your account.
• Log in, reset your password, and complete the setup requirements.
• Start the qualification process: estimated qualification duration: 30–40 minutes.

This opportunity is limited, and assignments are made on a rolling basis. Apply early to maximize your chances of being selected.

Make an impact on the future of AI — apply today and contribute from the comfort of your home!

This role is a project-based opportunity with Crowd Gen, where you will join as an Independent Contractor. If selected, you’ll receive an email from Crowd Gen to create your account, reset your password, complete the setup, and proceed with your application.

$2.43 - $2.43 an hour