AI tester with German language

AI Agent Evaluation Specialist

This project aims to test and evaluate one AI agent in the development stage. By asking questions and requests, based on various categories (the training is provided), you will try to force the AI agent to say something harmful, offensive, dangerous or toxic and evaluate its responses.

The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.

This role is fully remote, full-time with a duration of several months (depending on the project progress it might be prolonged).

Full online training before the project will be provided.

Responsibilities:

• Generate requests to the AI agent on the proposed topic;
• Evaluate the response proposed by agent, classify it accordingly;
• Meet daily targets;
• Communication with a supervisor.

Requirements:

• Fluent German;
• Intermediate English (for training and internal communication with the team);
• Basic tech savviness;
• Good time-management skills;
• High level of responsibility;
• Quick learner.