Safeguards Enforcement Analyst, Bio Harms

Safeguards Enforcement Analyst, Bio Harms

Remote-Friendly, United States;
San Francisco, CA | New York City, NY | Washington, DC

As an Enforcement Analyst focused on Bio Harms, you will play a critical role in protecting against the misuse of AI systems for biological and related CBRNE harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating bio risks, investigating potential violations, and help continuously strengthen our safeguards. The work sits at the intersection of biosecurity threat analysis and platform enforcement: you will read real model interactions and make fast, well-reasoned calls about whether activity is benign research or a credible attempt at harm.

This role is a fit for someone who understands the dual-use nature of biology and enabling technologies well enough to separate the benign from the malicious. You will own and continuously improve the enforcement monitoring workflows for the bio-harms area, and you will work closely with Policy, Threat Intelligence, Data Science, and Engineering cross-functional partners to accomplish tasks ety is core to our mission, and your work will directly protect individuals, communities, and critical systems.

Important context for the role:
In this position you may be exposed to and engage with explicit content spanning a range of topics, including material of a sexual, violent, or psychologically disturbing nature. The role also carries a shared on-call responsibility across the Policy and Enforcement teams.

• Enforce Usage Policies with a specific focus on detecting and mitigating potential bio risks and harmful use of AI systems.
• Take ownership of enforcement monitoring workflows for the bio-harms area, improving end-to-end detection, investigation, triage, and escalation processes.
• Monitor and analyze platform activity to identify emerging patterns related to biological (and adjacent chemical, radiological, nuclear, and explosive) threats that may require policy updates or enforcement action.
• Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
• Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
• Proactively surface trends and propose improvements to detection methods and review workflows.
• Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for bio-related policy violations.
• Partner with Policy and Threat Intelligence groups to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
• Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to potential bio-related Usage Policy violations.

• Hold a degree in a bio-related field (e.g., microbiology, molecular biology, biochemistry, public health) and/or relevant professional experience in a related field.
• Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
• Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
• Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure.
• Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative.
• Communicate clearly in writing and can translate technical bio concepts for diverse audiences, including both technical and non-technical stakeholders.

• Subject matter expertise in biodefense, biosecurity, WMD/CBRNE non-proliferation, or threat-intelligence.
• An understanding of where real-world biological risk actually lies — adversary intent, acquisition and weaponization pathways, and dual-use concerns, including familiarity with cross-platform threat analysis and open-source intelligence (OSINT) techniques relevant to weapons of mass destruction.
• Proficiency in SQL and/or other data analysis tools to draw insights from large datasets and monitor enforcement workflow health.
• Familiarity with dual-use research of concern (DURC), select agents, and relevant policy frameworks.

The annual compensation range for this role is listed below. For sales roles, the range provided is the role's On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary:

$245,000 - $285,000 USD

Minimum education:

Bachelor's degree or an equivalent combination of education, training, and/or experience

Required field of study: A field relevant to the role as demonstrated through coursework, training, or…