Moderator | Onsite Data Collection

At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use a combination of Experts + Crowd + Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domains—from doctors and lawyers to physicists and engineers—and boast one of the most diverse global crowds,
representing over
100 countries and speaking 40+ languages
. We are a well-funded startup with an enviable portfolio of clients including Anthropic ,
Amazon ,
Microsoft ,
poolside ,
Recraft , and Shopify
.

Recently, we secured strategic investment led by Bezos Expeditions with participation from Mikhail Parakhin ,
CTO of Shopify and board advisor to leading GenAI companies, who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world:
USA ,
UK ,
the Netherlands ,
Serbia , and more. We are headquartered in Amsterdam.

We’re looking for friendly, tech-comfortable moderators to guide participants through in-person data collection sessions. You’ll welcome participants, explain each task clearly and guide participants through the process, run the session on iOS devices and a laptop terminal, and make sure every session is completed accurately and on time. This role suits someone with a customer-service background who enjoys working with technology and people from many backgrounds.

• Welcome participants, confirm their check-in, and clearly explain session instructions in English.
• Set up and operate iOS devices for each session, including switching device language and region settings, and troubleshoot basic device issues.
• Run provided scripts from a terminal window by following a step-by-step guide, then confirm each session completed successfully.
• Keep participants comfortable, on task, and on schedule, and handle questions with patience and professionalism.
• Log session details, report technical or participant issues to the onsite project lead, and follow data privacy and quality procedures.

Knowledge of additional languages is a plus but not required. Professional or fluent proficiency in one or more of the following languages is an advantage:
French (France),
Japanese ,
Korean ,
European Portuguese (Portugal),
German (Germany or Austria),
Dutch ,
Swedish ,
Arabic ,
Hebrew , or Polish
. Candidates with proficiency in multiple listed languages are especially encouraged to apply.

• Fluent English and the ability to communicate clearly and professionally.
• Experience in customer service, hospitality, front-desk operations, or other participant-facing roles.
• Comfort using iPhones or iPads, including navigating settings, managing apps, and performing basic troubleshooting.
• Ability to open a terminal and run commands or scripts from written instructions. No coding is required, and training is provided.
• Strong attention to detail and the ability to follow procedures accurately.
• Reliability, punctuality, and a responsible approach to scheduled sessions.
• Good interpersonal skills and the ability to guide participants patiently and professionally.
• Availability to work onsite in NYC as soon as possible, with interest in continuing on a month-to-month basis.

• Familiarity with macOS.
• Experience with user research, usability testing, data collection, or consumer studies.
• Experience working with right-to-left languages, such as Arabic or Hebrew, on iOS devices.

Experience in one or more of the following areas is a plus:

• Assistant Director or Production Assistant experience: Experience…