Quality Assurance Specialist

Help ensure AI-powered applications behave reliably and safely in everyday use. You’ll test prompts, model responses, and multi-turn conversations, then work with engineering and prompt design colleagues to address issues before and after release.

• Run structured tests across prompts, response flows, and unusual or high-risk scenarios.
• Assess responses for accuracy, consistency, relevance, bias, hallucinations, and safety concerns.
• Check application behavior before and after deployment, including errors, logs, response stability, latency, and token use.
• Record findings with the relevant prompts, outputs, and clear steps for reproducing each issue.
• Review the quality and consistency of AI-generated training data and annotations.
• Collaborate with developers and prompt engineers to validate fixes and improvements.

• Hands-on experience testing generative AI, language models, or conversational applications.
• Familiarity with prompt and output evaluation, including multi-turn interactions.
• Ability to spot inaccurate, inconsistent, biased, or unsafe AI responses.
• Experience working with AI service APIs or model integrations and reviewing logs or performance indicators.
• Basic understanding of natural language processing and language model behavior.
• Careful, systematic approach to testing, edge cases, and issue documentation.

Remote independent-contractor role for candidates based in Singapore or the Philippines.