Research Scientist; Seed Model-Alignment&Preparedness PhD

Location:

San Jose

Team:

Technology

Employment Type:

Regular

Job Code:

A59867

Share this listing:

• Agent RL & safety training:
  Use RL, SFT, and preference optimization to train agents safely. Design environments, rewards, and training data that reduce deception, reward hacking, and unauthorized actions, and teach agents to check authorization, recognize risks, and stop when needed, without sacrificing useful autonomy. Ensure safety generalizes to new tasks and holds up through further training.
• Frontier risk assessment:
  Partner with domain experts to evaluate dangerous capabilities (e.g., CBRN, cybersecurity), model threats, and build safeguards. Provide empirical evidence to guide development and deployment decisions.
• Automated red teaming:
  Build automated attack generation and adversarial training methods to harden models against jailbreaks, prompt injection, and other adversarial inputs.
• Monitoring & oversight:
  Detect risks from inputs and outputs, execution traces, chains of thought, and internal representations. Build oversight models, action review, and permission controls, and measure their effectiveness, evasion resistance, and cost.
• Failure analysis & deployment:
  Turn real-world failures into reproducible experiments and pinpoint root causes through controlled studies and ablations. Work with pre-training, post-training, infra, and product teams to ship what works at scale.

• Individuals who are completing or have recently completed a PhD degree in Computer Science, Electrical Engineering, Electrical and Computer Engineering, Physics, Mathematics, or a related discipline.
• Strong foundations in ML, deep learning, and statistics, with research or engineering experience in LLMs, RL, or related fields.
• Proficiency in Python and PyTorch (or similar), with the ability to independently implement algorithms, build experiment pipelines, and debug data, training, and evaluation issues.
• Deep hands-on experience in at least one of the following: agent RL, model training, dataset development, agent systems, evaluation, or ML infrastructure.
• Ability to turn open-ended questions about model behavior into testable hypotheses, run experiments, and clearly communicate results and limitations to research, engineering, and domain partners.
• A genuine commitment to advancing safety alongside capabilities, and comfort with ambiguous, unsolved problems.
• Experience with agent RL, including environment design, reward design for multi-step tasks, and long-horizon or multi-agent training.
• Experience with SFT, RLHF/RLAIF/RLVR, distributed training, or automated red teaming.
• Research experience in AI control, scalable oversight, CoT monitoring, mechanistic interpretability, or prompt injection defense.
• Experience evaluating or mitigating risks in high-stakes domains such as CBRN or cybersecurity.
• Strong publications, open-source contributions, or a track record of applying research to real-world systems.

The base salary range for this position in the selected city is $254400 - $480000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative…