Senior Data Scientist - M365 Copilot, Agents & Platform - Turing Team

** Overview*
* Join the Microsoft  
** Turing team
** and  
** help shape the future of enterprise and consumer productivity with M365 Copilot.*
* Join a fast-paced, high-visibility, and diverse team delivering innovative platform capabilities and solutions across Microsoft to hundreds of millions of users every month. As a  
** Senior Data Scientist
** on the  
** Microsoft Turing team** ,  
** you will help transform how organizations use data by preparing and analyzing large-scale datasets, designing evaluations, running experiments, and driving evidence-based decisions with measurable business impact. You'll work in small, multidisciplinary crews alongside engineers, product managers, applied scientists, and domain experts, owning the analytical lifecycle from data discovery and study design through measurement, insight generation, and product recommendations** .

Our work is powered by AI, applying data, experimentation, and evaluation across the development lifecycle while maintaining the highest standards of security, quality, and trust.  
** The Microsoft Turing team is an innovative applied research and engineering organization advancing large language models and pioneering conversational search experiences. We build core platform capabilities behind Microsoft 365 Copilot, bringing AI-powered experiences into production at enterprise scale and transforming how organizations work every day. We spearhead platform innovation for multiple core Copilot experiences across Microsoft's ecosystem** .

We are a fast-growing team with a broad and evolving set of opportunities. Project assignments are shaped by your interests, experience, and strengths, allowing you to grow while working on problems that matter to you.

Recent launches, such as the Analyst agent in Microsoft 365 Copilot, demonstrate the importance of rigorous measurement and evaluation across the AI stack.  
** The Microsoft Turing team combines engineering and research excellence to advance large-scale AI systems. In this environment, Data Scientists define measurement strategies, build evaluation datasets, design experiments, and translate results into product recommendations, while partnering with software engineers and applied scientists who develop and product ionize the underlying systems and models.*
* Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

** Responsibilities*
* Data Analysis & Evaluation Dataset Development

+ Write efficient, readable code in Python, SQL, KQL, or similar languages to prepare and analyze large-scale datasets, including customer feedback, text, and consented multimodal logs.

+ Build representative evaluation datasets across enterprise and consumer scenarios, including information retrieval, text creation and editing, image and file workflows, shopping, education, coding, technical support, health, sports, news, and finance.

+ Design evaluation coverage for text and voice inputs, single- and multi-turn conversations, and location- or geography-sensitive prompts.

Cross-Functional Collaboration

+ Partner with engineering, product management, and applied science teams to define measurement strategies and inform product decisions.

+ Share findings, limitations, and recommendations that improve Microsoft 365 Copilot experiences.

Experimentation & A/B Testing

+ Own experiment design and impact measurement for optimization hypotheses, including success metrics, guardrails, and interpretation of results.

+ Contribute to response-quality side-by-side evaluations by designing studies and rubrics, analyzing results, and assessing statistical and practical significance.

+ Compare LLM-based and human evaluations, validate alignment, investigate false positives and branding bias, and refine studies accordingly.

Insights & Decision Influence

+ Develop decision-relevant metrics, dashboards, and compelling narratives that translate analyses into actionable product recommendations.

+ Present findings and analytical limitations to technical and executive audiences, build stakeholder support, and guide decisions on key product initiatives.

Thought Leadership

+ Stay current with AI offerings and competitive developments, using data and evaluation…