Skip to content
×

AI Content Red Team Analyst - Trust and Safety

Job in Singapore, Singapore
Listing for: ByteDance
Full Time position Listed on 2026-10-27
Job specializations:
Salary/Wage Range or Industry Benchmark: 120000 - 180000 SGD Yearly SGD 120000.00 180000.00 YEAR

Job Description & How to Apply Below

Responsibilities

About the team:

The Trust & Safety (T&S) GenAI & Emerging Product team's mission is to empower the development of GenAI models and applications. We do this by building a world-class safety, testing, and risk management system that ensures GenAI innovations are launched responsibly.

The AI Content Red Team sits within the T&S GenAI and Emerging Products pillar. The team is responsible for conducting unstructured adversarial testing of Byte Dance's generative AI products and models to uncover emerging risks, alongside our structured evaluations.

This team combines attacker-minded testing, risk discovery, and clear operational feedback loops to inform product decisions, policy development, mitigations, and longer-term evaluation strategy. We probe models and product experiences across modalities, use cases, and abuse patterns to identify failure modes, stress-test safeguards, and help teams improve safety before and after launch.

We work closely with Trust & Safety teams (policy, product, engineering, data science, operations), and business teams across global markets. Success in this team requires strong judgment, creativity, analytical rigor, and the ability to translate ambiguous findings into actionable recommendations.

Key Responsibilities
  • Conduct structured adversarial testing on AI models, features, and policies to identify vulnerabilities and emerging risks.
  • Explore product behavior across contexts and user journeys, to identify model failure modes that may not be captured in standard evaluations.
  • Investigate jailbreaks, evasions, prompt-based attacks, and other adversarial techniques relevant to content safety.
  • Document findings clearly and consistently, including risk descriptions, reproduction steps, severity assessments, and mitigation recommendations.
  • Partner with cross functional stakeholders (policy, product, business teams) to ensure mitigation validation and root cause closure
  • Support development of testing playbooks, taxonomies, and internal knowledge bases
  • Stay updated on emerging adversarial trends (e.g., deepfakes, multimodal manipulation, coordinated abuse), and shifts in the external risk landscape
Qualifications Minimum Qualification(s)
  • 3+ years in Trust & Safety, cybersecurity, risk/adversarial testing, or related fields
  • Experience with prompt testing, jailbreak analysis, LLM evaluation, or adversarial QA
  • Familiarity with AI safety risks (jailbreaks, hallucinations, bias, misuse patterns)
  • Strong interest in GenAI safety, and the ways AI systems can be compromised under adversarial conditions.
  • Demonstrated ability to independently investigate ambiguous problems, identify non-obvious failure modes and abuse patterns, and produce clear, evidence-based conclusions
  • Strong communication skills
  • Ability to manage multiple priorities, and collaborate effectively with cross-functional teams
Preferred Qualification(s)
  • Experience working with agentic AI tools to scale your impact, including building/operating AI tools to make processes efficient and effective.
Trust & Safety at Byte Dance

Content that this role interacts with includes images, video, and text related to everyday life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals. Hence, it is possible that this role will be exposed to harmful content on a daily basis.

Byte Dance recognises that keeping our platform safe for the Byte Dance communities is no ordinary job which can be both rewarding and psychologically demanding and emotionally taxing for some. This is why we are sharing the potential hazards, risks and implications in this unique line of work from the start, so our candidates are well informed before joining.

We are committed to the wellbeing of all our employees and promise to provide comprehensive and evidence-based programs, to promote and support physical and mental wellbeing throughout each employee's journey with us. We believe that wellbeing is a relationship and that everyone has a part to play, so we work in collaboration and consultation with our employees and across our functions in order to ensure a truly person-centred, innovative and integrated approach.

About

Us

Founded in 2012, Byte Dance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including Tik Tok, Lemon8, Cap Cut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, Byte Dance has made it…

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary