Senior Researcher, Civil Safety Sciences

Job Summary

AI is compressing the timelines on which genuinely novel threats emerge, opening hazard classes that fall outside the established CBRN-and-cyber playbooks that governments are organizing themselves to address. The most consequential risks may be ones for which no detection apparatus, response doctrine, or scientific community yet exists.

CARMA's Civil Safety Sciences program advances the detection sciences, response protocols, and resilience technologies that let people, communities, and the biosphere better foresee, curtail, endure, and recover from civilizational shocks. In this role, you'll help shape that portfolio: anticipating novel hazard classes, advancing next-generation detection and resilience approaches, identifying safety technologies whose earlier maturation shifts the offense-defense balance, and weaving the scientific coordination that lets dispersed researchers function as a coherent field.

You'll work under the direction of the Executive Director while running projects with significant intellectual autonomy.

This position is 100% remote but requires occasional travel, including periodic visits to laboratories and research groups for technical discussions and demonstrations.

The Center for AI Risk Management & Alignment (CARMA) works to help society navigate the complex and potentially catastrophic risks arising from increasingly powerful AI systems. Our mission is specifically to lower the risks to humanity and the biosphere from transformative AI.

We focus on grounding AI risk management in rigorous analysis, developing policy frameworks that squarely address AGI, advancing technical safety approaches, and fostering global perspectives on durable safety. Through these complementary approaches, CARMA aims to provide critical support to society for managing the outsized risks from advanced AI before they materialize.

CARMA is a fiscally-sponsored project of Social & Environmental Entrepreneurs, Inc., a 501(c)(3) nonprofit public benefit corporation.

• Conduct structured horizon-scanning for novel AI-enabled hazard classes, and develop methodologies for reasoning rigorously about threats that lack historical base rates or established scientific communities
• Investigate next-generation detection sciences, such as dynamic and adaptive pathogen surveillance, and analogous open-ended approaches for other emerging hazard modalities
• Pursue feasibility analyses on deep resilience and lifeline capacities engineered to function when conventional infrastructure, sunlight, or centralized coordination cannot be assumed
• Analyze biosphere-scale vulnerabilities, including geoengineering, synthetic microbes for terraforming or remediation, and nontraditional environmental toxicology arising from AI-enabled activity
• Identify and selectively advance defensive, stabilizing, and transparency-enhancing technologies whose differential acceleration favors humanity
• Develop scientific meta research on how evidence is generated, aggregated, and translated into action where conventional empirical feedback loops are weak
• Build scientific coordination capacity through standards, convenings, and cross-border working relationships, and equip frontline responders and community networks with usable decision support
• Co-author grant applications, build analytical tools that make catastrophic risks more legible, and translate findings for policymakers, technical audiences, and the public
• Collaborate across CARMA programs to integrate civil safety perspectives with broader risk assessment, governance, and technical safety work streams

• Advanced degree (PhD or >1 MS preferred) in a hard-science or engineering discipline, with demonstrated breadth across multiple natural science fields. Strong candidates may come from any of, or combinations across: biosecurity, microbiology, ecology, environmental or atmospheric science, agricultural and food systems science, chemistry, materials science, physics, public health, biomedical or systems engineering, resilience engineering, security sciences, or related fields
• Substantive familiarity with adversarial environments and…