AI Model Evaluation & Quality Strategy Specialist Graduate; AI Data Service Operations

AI Model Evaluation & Quality Strategy Specialist Graduate (AI Data Service Operations) - 2027 Start

Location:

Jakarta

Employment Type:

Regular

Job Code:

A24494

About the Team Generative AI and large language models are reshaping the core capabilities of global content platforms — and high-quality training and evaluation data is one of the key factors that determines a model's ceiling.

We are the AI Data Service & Operations (ADSO) team behind Tik Tok's international products, responsible for producing multilingual, multimodal data assets across both safety and non-safety domains. The standards we set and the data we deliver power two critical fronts:
Tik Tok's global content ecosystem governance strategy on one side, and the training and evaluation pipelines for AI / large language models on the other. In short, we produce the fuel that helps models truly understand content, communities, and users around the world.

Role Summary We are looking for an AI Model Evaluation & Quality Strategy Specialist to help define what high-quality data means for large model training and evaluation. This role focuses on quality standards, judgment rules, complex case assessment, issue correction, and feedback loops that improve AI model evaluation outcomes across markets.

We are looking for talented individuals to join our team. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth.

• Participate in defining and continuously improving data quality standards, judgment rules, and acceptance criteria for large model training and evaluation scenarios.
• Review data outputs against quality standards, identify issues, drive correction loops, and ensure accuracy and consistency.
• Assess complex, ambiguous, and boundary cases, and turn decisions into reusable judgment rules and knowledge assets.
• Track quality performance, analyze root causes, and recommend improvements to production-side workflows and execution.
• Work with production, product, algorithm, strategy, and quality teams to align standards across the full chain from standard-setting to production, acceptance, and feedback.

• Individuals who are completing or have recently completed a Bachelor's degree in law, philosophy, economics, journalism, languages, social sciences, data, or related fields are welcome.
• Internship or project experience in data quality, content review, compliance, content operations, AI data, annotation, policy, or quality evaluation is preferred.
• Excellent English listening, speaking, reading, and writing skills, with the ability to accurately understand English video and text content.
• Familiar with Excel or other common data processing tools; deep hands-on use of ChatGPT, Claude, Gemini or similar large model products is preferred.
• Strong structured thinking, abstraction, judgment, and communication skills; detail-oriented and able to explain what high-quality data means in ambiguous cases.

About Tik Tok

Tik Tok is the leading destination for short-form mobile video. At Tik Tok, our mission is to inspire creativity and bring joy. Tik Tok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Inspiring creativity is at the core of Tik Tok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users.

When we create and grow together, the possibilities are limitless. Join us.

Tik Tok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At Tik Tok, our mission is to inspire creativity and bring joy. To achieve that goal, we are…