AI Evaluation & Annotation Specialist; Entry-Mid Level - Japanese

Are you curious, detail-oriented, and excited about shaping the future of artificial intelligence?

We’re looking for
AI Evaluation & Annotation Specialists
to help train and improve Large Language Models (LLMs). In this role, you’ll review AI-generated responses, provide corrections, evaluate quality, and follow structured guidelines to ensure accuracy and consistency.

No engineering background required — if you enjoy problem-solving, analyzing language, and following structured tasks, this role is a great fit.

This is a
hands-on, production-based role
where accuracy, focus, and consistency matter.

• Review AI-generated responses and rate them for clarity, correctness, and relevance.
• Annotate and label content based on project-specific guidelines.
• Follow detailed written instructions and apply them consistently.
• Generate or evaluate prompts depending on assignment type.
  
  Work with QA Leads to apply feedback and continuously improve task quality.
• Report completed work daily and meet productivity and quality standards.

• You’re
  detail-oriented
  and enjoy accuracy-based work.
• You can follow instructions carefully and apply them consistently.
• You’re comfortable working independently with minimal supervision.
• You have strong reading comprehension and critical thinking skills.
• You communicate clearly and respond to feedback professionally.

Experience with
annotation, evaluation, translation, linguistics, or QA
is helpful, but not required — training and guidance is provided.

This role is aligned with specific QA and project schedules. You must be available during one of the below time windows depending on your language team:

06:30–15:30

ISTOR
19:30–03:30

IST

• Standard expectation:
  One consecutive 8-hour shift
• Alternative:
  Two 4-hour shifts
  (both must fall fully within the allowed schedule)
• Only logged, approved hours are paid.

This project follows a
no paid holidays / no paid time off model.

✔ Work with a global team

✔ Entry point into the growing AI and language technology industry

✔ Exposure to real-world AI model training

✔ Skill development in annotation, QA/evaluation, and structured AI tasks

This is a strong opportunity for those looking to grow within
AI data work, linguistic evaluation, QA, or model training roles
.

Rates vary by language and experience level (L1/L2). Below are current approved ranges in USD:

$12.00 USD to $16.00 USD per hour

All applicants are required to complete a short skills-based assessment as part of the selection process. This assessment is
unpaid
and is used solely to confirm eligibility and alignment with project quality standards.

Completing the assessment does not guarantee selection; however, it is
mandatory
in order to be considered for this role.

• Fluency in Japanese, with strong written and verbal communication skills.
• Bachelor's degree in Linguistics, Computer Science, or a related field; or equivalent experience.
• Experience or interest in AI, Machine Learning, or data annotation preferred.
• Strong attention to detail and ability to work with complex data sets.
• Familiarity with translation and localization processes is an advantage.
• Ability to work independently and collaboratively in a fast-paced environment.
• Proficient in using Artificial Intelligence and data annotation tools, with a willingness to learn new technologies.