Data Scientist, Foundation AI - PhD Early Career

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

The Data Science & Analytics organization's mission is to increase our speed, frequency, and acumen in making decisions at scale by instilling a data-influenced approach to building products. We cover a wide area of the data spectrum, including analytical data engineering, product analytics, experimentation, causal inference, statistical modeling, and machine learning. Aligned and partnered with product verticals, we use this extensive tool belt to discover new opportunities and unmet use cases, influence and craft the product roadmap, and prioritize, build data products, and measure impact on our community of players and developers.

Our team’s mission is to enable Roblox Creators to bring GenAI capabilities to millions of users. We drive this innovation with a core commitment to safety, responsibility, and quality.

• Develop Evaluation Frameworks:
  Design and operationalize rigorous evaluation systems for either GenAI features (text, image, video, 3D, 4D). This includes eval experiment design, dataset design, label reliability analysis, and implementing and fine tuning LLM-as-judge methods.
• Run Rigorous Experiments:
  Conduct online experiments (A/B tests) and causal inference to quantify the impact of GenAI features. You will identify opportunities, measure lift, and ensure statistical rigor.
• Define Success Metrics:
  Partner with cross-functional teams to define leading/lagging indicators for GenAI feature user satisfaction, business success, and safety.
• Build Automated Systems:
  Research and apply state-of-the-art methodologies to build reproducible evaluation tooling that lift rigor and efficiency across the company.
• Conduct Applied Research at the Frontier:
  Maintain an active pulse on the intersection of Gen AI and Data Science. You will innovate on methodology and techniques to solve unique business challenges while contributing to the broader field in the technical community.

• Possess or pursuing a PhD or equivalent in Statistics, Economics, Computer Science, Applied Math, Physics, Engineering, or a related quantitative field.
• Technical Proficiency:
  Strong proficiency in SQL (Hive/Spark) for manipulating large datasets and scripting languages (Python or R) for analysis and modeling.
• Experimentation and Causal Inference: A solid grounding in experimentation, causal inference, and statistical analysis, including test design and metric design for feature impact.
• Problem Solving: A demonstrated track record of framing ambiguous problems, designing analytical approaches, and solving open-ended data science problems that drive business impact.
• Learning Agility:
  Ability to effectively and responsibly use AI tools to enhance productivity and a passion for continuously improving methods in a fast-evolving field.
• GenAI Familiarity:
  Familiarity with GenAI models and safety/quality evaluation methods. Expertise in the model training lifecycle is a plus (e.g., fine-tuning, RLHF, or synthetic data generation).
• Applied Research Background: A track record of applied research or publications in relevant technical fields is highly valued.

You may redact age, date of birth, and dates of attendance/graduation from your resume if you prefer.

For roles that are based at our headquarters in San Mateo, CA:
The starting base pay for this position is as shown below. The actual base pay is dependent upon a…