×
Register Here to Apply for Jobs or Post Jobs. X

Research Scientist

Job in San Francisco, San Francisco County, California, 94199, USA
Listing for: Key Talent Solutions
Full Time position
Listed on 2026-10-16
Job specializations:
  • Research/Development
    AI Evaluation, Research Scientist, Data Scientist
Salary/Wage Range or Industry Benchmark: 250000 - 450000 USD Yearly USD 250000.00 450000.00 YEAR
Job Description & How to Apply Below

A Series B AI data company, valued at about $3.2B, that builds expert datasets, evals and RL environments for frontier AI labs.

About the Role

We are looking for a Research Scientist - Post Training to join a post-training research team focused on understanding how training data improves the capabilities, generalisation and alignment of large language models (LLMs).

In this role, you will design and run controlled training experiments using supervised fine-tuning (SFT) and reinforcement learning (RL)-based post-training techniques. You will investigate how different datasets influence model behaviour and translate your findings into actionable recommendations for improving data quality, selection and production.

Working closely with research partners, you will generate clear, reproducible evidence of how specific datasets contribute to measurable model improvements. You will also contribute to evaluation infrastructure and benchmarks across models, capabilities and domains.

This is a hands-on, experimental role combining research, technical evaluation and collaboration with external partners.

Key Responsibilities
  • Design and run controlled SFT and RL experiments to measure the impact of training datasets on model performance.
  • Evaluate how different data sources affect model capabilities, generalisation and alignment.
  • Help develop public evaluations, benchmarks and new data types that advance LLM capabilities.
  • Publish external-facing research, technical reports and blog posts.
  • Collaborate with internal stakeholders to improve data quality based on experimental findings.
  • Analyse complex or noisy experimental results and turn them into clear, actionable insights.
  • Contribute to reproducible evaluation methods across models, capabilities and technical domains.
Required Qualifications
  • Must have held a founding-level role and graduated from a top-tier technical university
  • Strong familiarity with LLM training and evaluation methodologies.
  • Ability to design lightweight experiments, work quickly and extract actionable insights from complex results.
  • Comfort working across multiple domains, including finance, software engineering and policy.
  • A hands-on, building-oriented mindset, with a focus on experimentation and practical outcomes.
  • Previous experience at a frontier AI research lab.
Red Flags
  • PhD-only researcher profile with no demonstrated track record of shipping practical solutions. The role explicitly favours hands‑on builders over purely academic researchers.
  • Treats evaluation as reporting benchmark scores rather than diagnosing why model behaviour changed.
Green Flags
  • Has built evaluation harnesses, training pipelines, benchmarks or other experimental infrastructure.
  • Has worked at or alongside a frontier AI lab, RL environment company, AI safety organisation or benchmarking organisation.
  • Has published research or completed meaningful projects involving model evaluation, post‑training or data curation.
Compensation and Benefits
  • Base salary of $150,000–$250,000 per year.
  • Additional compensation through profit sharing, with total cash compensation potentially reaching $250,000–$450,000.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary