Research Scientist - AI & Safety; Seed

Location:

San Jose

Team:

Technology

Employment Type:

Regular

Job Code:

A248193

Share this listing:

Responsibilities

Seed Model–Alignment & Preparedness is dedicated to advancing AI safety alongside frontier model capabilities. Backed by sustained investment and substantial compute resources, we tackle fundamental challenges in alignment, safety evaluation, and preparedness for emerging risks—translating research into safe, reliable AI systems that benefit people.

We’re looking for researchers to make frontier models and agents safer, with a strong focus on agent RL: training agents that stay safe and controllable in tool use, code execution, and long-horizon tasks.

Responsibilities
- Agent RL & safety training:
Use RL, SFT, and preference optimization to train agents safely. Design environments, rewards, and training data that reduce deception, reward hacking, and unauthorized actions, and teach agents to check authorization, recognize risks, and stop when needed, without sacrificing useful autonomy. Ensure safety generalizes to new tasks and holds up through further training.

- Frontier risk assessment:
Partner with domain experts to evaluate dangerous capabilities (e.g., CBRN, cybersecurity), model threats, and build safeguards. Provide empirical evidence to guide development and deployment decisions.

- Automated red teaming:
Build automated attack generation and adversarial training methods to harden models against jailbreaks, prompt injection, and other adversarial inputs.

- Monitoring & oversight:
Detect risks from inputs and outputs, execution traces, chains of thought, and internal representations. Build oversight models, action review, and permission controls, and measure their effectiveness, evasion resistance, and cost.

- Failure analysis & deployment:
Turn real-world failures into reproducible experiments and pinpoint root causes through controlled studies and ablations. Work with pre-training, post-training, infra, and product teams to ship what works at scale.

Qualifications

Minimum Qualifications:

- Strong foundations in ML, deep learning, and statistics, with research or engineering experience in LLMs, RL, or related fields.

- Proficiency in Python and PyTorch (or similar), with the ability to independently implement algorithms, build experiment pipelines, and debug data, training, and evaluation issues.

- Deep hands-on experience in at least one of the following: agent RL, model training, dataset development, agent systems, evaluation, or ML infrastructure.

- Ability to turn open-ended questions about model behavior into testable hypotheses, run experiments, and clearly communicate results and limitations to research, engineering, and domain partners.

- A genuine commitment to advancing safety alongside capabilities, and comfort with ambiguous, unsolved problems.

Preferred Qualifications

- Experience with agent RL, including environment design, reward design for multi-step tasks, and long-horizon or multi-agent training.

- Experience with SFT, RLHF/RLAIF/RLVR, distributed training, or automated red teaming.

- Research experience in AI control, scalable oversight, CoT monitoring, mechanistic interpretability, or prompt injection defense.

- Experience evaluating or mitigating risks in high-stakes domains such as CBRN or cybersecurity.

- Strong publications, open-source contributions, or a track record of applying research to real-world systems.

Job Information

The base salary range for this position in the selected city is $254400 - $588000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and…