AI Fact-Checking & Response Evaluation Reviewer; Portuguese

Position: AI Fact-Checking & Response Evaluation Reviewer (Portuguese)
AI Fact-Checking & Response Evaluation Reviewer (French) Mission of the Role

Apply independent judgment to identify AI blind spots, reasoning failures, factual inaccuracies, contradictory evidence, and quality gaps.

Successful reviewers do not simply validate AI-generated conclusions, they critically evaluate them. Your role is to verify evidence, challenge unsupported assumptions, and ensure AI systems learn from accurate, reliable, and well-supported information.

Your expertise will help build more reliable, trustworthy, and human-centered AI systems.

About the Role

At Trust Scale, we believe AI improves when people are willing to question it.

As an AI Fact-Checking & Response Evaluation Reviewer, you will evaluate AI-generated responses, verify evidence, challenge unsupported conclusions, and help define the standards that AI systems learn from.

Good AI is built on good judgment.

Trust Scale is seeking experienced Spanish
-language professionals to evaluate AI-generated responses, verify factual accuracy, assess supporting evidence, and help define the quality standards that AI systems learn from.

As an AI Fact-Checking & Response Evaluation Reviewer, you will review AI-generated content, determine whether conclusions are supported by evidence, identify reasoning gaps, challenge unsupported claims, and help improve the reliability of next-generation AI systems.

This is not a traditional annotation, translation, or data-entry role.

This role requires individuals who are comfortable questioning conclusions, investigating claims, and making evidence-based decisions—even when those decisions differ from AI-generated recommendations.

The strongest reviewers are naturally curious, skeptical of unsupported claims, detail-oriented, and confident applying their own judgment when evaluating information.

This is a remote freelance opportunity with flexible hours and payment in USD.

What You’ll Do

• Review and evaluate AI-generated responses in Portuguese
• Verify factual claims using reliable online sources and supporting evidence
• Assess whether evidence supports, contradicts, or fails to support AI-generated conclusions
• Identify AI blind spots, reasoning failures, factual inaccuracies, and quality gaps
• Evaluate response quality, relevance, completeness, and alignment with user intent
• Detect inconsistencies, unsupported claims, contradictory information, and missing evidence
• Apply independent judgment rather than relying solely on automated decisions
• Challenge AI-generated conclusions when evidence suggests a different outcome
• Provide clear quality feedback and rationale for review decisions
• Participate in training, calibration, and quality alignment sessions conducted in English
• Maintain quality, consistency, commitment, and productivity expectations while meeting project requirements
• Collaborate with project teams to continuously improve reviewer standards and AI quality outcomes

What Success Looks Like

Successful reviewers:

• Verify information before accepting conclusions
• Challenge AI-generated decisions when evidence suggests otherwise
• Distinguish between supported, unsupported, and contradictory claims
• Remain objective when evaluating information
• Demonstrate consistency across complex review tasks
• Maintain strong productivity while preserving quality standards
• Use evidence rather than assumptions to make decisions
• Take ownership of quality outcomes
• Demonstrate reliability and commitment throughout the project lifecycle

Required Qualifications

• Native or near-native fluency in Portuguese
• Strong English proficiency, including the ability to understand guidelines and participate in training sessions
• Previous experience in Fact-Checking, Quality Assurance, Content Review, Search Evaluation, Annotation Review, Trust & Safety, Data Quality, Linguistic QA, Research Analysis, or similar analytical roles
• Excellent critical-thinking and analytical skills
• Strong evidence-based decision-making abilities
• Strong attention to detail and consistency
• Ability to independently evaluate and challenge AI-generated conclusions
• Ability to distinguish between factual support, contradiction, and insufficient evidence
• Ability to interpret complex queries and assess response quality accurately
• Comfortable working with structured data and AI-related projects
• Comfortable working with ambiguity and incomplete information
• Ability to pass a qualification assessment in English/Portuguese

Preferred Qualifications

• Experience reviewing AI training data or annotation projects
• Experience with Response…