Indonesian AI Model Rater

Join to apply for the Indonesian AI Model Rater role at Productive Playhouse
.

AI Model Rater, Indonesian (Coding knowledge required, with focus on APIs).

Join our team of Indonesian speakers with coding knowledge! Apply now to help improve the next generation of AI models' tool-use capabilities.

Location:

Remote, global (not US-based)
• Status:
Project-based
• Pay: USD $12 per hour
• Benefits:
Flexible schedule

To ensure eligibility for this project, applicants must be international freelancers. Unfortunately, we are unable to hire U.S. citizens, Green Card holders, or candidates currently residing in the U.S.

• Advanced/Expert fluency in Indonesian language, as spoken in the Indonesia region (ISO: )
• Strong comprehension of English (read and write)
• Strong conceptual knowledge of APIs and digital services (ability to understand how AI tools interact with external apps like search, maps, or calendar, without needing to write code).
• Ability to follow complex technical guidelines precisely.

• Analyze and rate AI-generated responses and their associated tool outputs against a detailed set of quality guidelines.
• Verify that the AI successfully integrates information from different digital services (APIs) as required by the prompt.
• Evaluate the accuracy, completeness, and overall quality of the AI's response and tool execution.
• Follow provided instructions to achieve task goals, with all evaluations recorded in English.

• All participants must have, or be willing to create, an Upwork account. The project will be managed via the Upwork platform.
• While participating in this project, adherence to the confidentiality terms outlined in the Upwork User Agreement is required. Any information accessed or received related to this project is confidential and may not be shared or disclosed to third parties.
• Applicants must pass a quick skill verification assessment (MC, duration ~10 minutes).
• Work must be performed on participant’s own devices. You must use your own laptop, and smartphone (if required).
• A Gmail account may be required to access certain tools. If you do not have a Gmail account, you must be willing to create one.
• Using AI during the assessment and work is STRICTLY forbidden, and results/inputs will be monitored to detect AI usage. Any detections will result in immediate ban from any future engagements.

About Us: As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services, including transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity.

The job description provided is designed to convey information essential to understanding the scope of the position and the general nature of the work performed. It is not intended to be an exhaustive list of duties, responsibilities, or qualifications associated with the job. Productive Playhouse reserves the right to modify or revise the job description as necessary.

Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees. Employment with Productive Playhouse is at-will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice.

All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location. Productive Playhouse participates in E-Verify.

Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities. If you need assistance or accommodation due to a disability, please contact the Human Resources Department.

• Entry level

• Contract – project-based

• Data Services - Evaluation and Quality Assurance