Senior GenAI Researcher: LLMs, RLHF & AI

Microsoft GenAI is looking for Senior Applied Researcher to join the team to build and optimize Large Language Models (LLMs) for various product usages as well as improving those from the perspective of Responsible AI. The work may include doing supervised fine-tuning of LLMs, applying Reinforcement Learning from Human Feedback in the process, and conducting thorough evaluation of those.

This new group, Microsoft GenAI, works on creating novel state-of-the-art AI models, related infrastructure, and customization tooling. It collaborates deeply with OpenAI and many Microsoft teams across the company, such as Azure AI Platform, Microsoft Research, and numerous product groups.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Qualifications

Required Qualifications

• Bachelor's Degree in Computer Science, Computational Linguistics, or relevant field AND 4+ years related experience
• OR Master's Degree in Computer Science, Computational Linguistics, or relevant field, or related field AND 3+ years related experience
• OR Doctorate in Computer Science, Computational Linguistics, or relevant field AND 1+ year(s) related experience
• OR equivalent experience.

Preferred Qualifications

• Doctorate in Computer Science, Computational Linguistics, or relevant field AND 2+ years related research experience OR equivalent experience.
• Rich experience in machine learning, particularly in NLP and deep learning.
• Experience with language model training and evaluation is a big plus.
• Experience with research in Responsible AI is a big plus.
• Proficiency in programming languages such as Python, and familiarity with machine learning frameworks including PyTorch and Triton.
• Experience with data processing and handling large datasets.
• Ability to work collaboratively in a team and communicate complex concepts effectively.

Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $112,000 - $218,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $145,800 - $238,600 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

Responsibilities

• Model Development and Training, including pre/post-training.
• Data Preparation and Processing, as well as data curation and mixing.
• Rigorous Performance Evaluation on the pre-trained and/or post-trained models.
• Collaboration with product groups in Microsoft.
• Research and Innovation; staying updated with the latest research and developments in deep learning and NLP.
• Embody our culture and values.