Language Data Scientist, Alexa International

Overview

Amazon is seeking a Language Data Scientist to join the Alexa International science team as a domain expert. This role focuses on expanding the analysis and evaluation of conversational interaction data deliverables, working closely with machine learning scientists and engineers to develop new conventions for annotation workflows and support the training and evaluation of LLMs and machine learning models.

• Own data analyses for customer‑facing features, including launch go/no‑go metrics for new features and accuracy metrics for existing features.
• Handle unique data analysis requests from a range of stakeholders, including quantitative and qualitative analyses to elevate customer experience with speech interfaces.
• Lead and evaluate changing dialogue evaluation conventions, test tooling developments, and pilot processes to support expansion to new data areas.
• Continuously evaluate workflow tools and processes and offer solutions to ensure they are efficient, high quality, and scalable.
• Provide expert support for a large and growing team of data analysts.
• Provide support for ongoing and new data collection efforts as a subject‑matter expert on conventions and use of the data.
• Conduct research studies to understand speech and customer‑Alexa interactions.
• Collaborate with scientists, product managers, and other stakeholders in defining and validating customer experience metrics.

• 2+ years of data scientist experience.
• 3+ years of experience with data querying languages (e.g., SQL), scripting languages (e.g., Python), or statistical/mathematical software (e.g., R, SAS, MATLAB).
• 3+ years of experience with machine learning/statistical modeling data analysis tools and techniques, including understanding performance parameters.
• 1+ year of experience guiding and coaching a group of researchers.
• 1+ year of experience working with or evaluating AI systems.
• 1+ year of experience creating or contributing to mathematical textbooks, research papers, or educational content.
• Master’s degree or higher in Science, Technology, Engineering, or Mathematics (STEM), or equivalent experience in STEM.
• Experience applying theoretical models in an applied environment.

• Ph.D. in Science, Technology, Engineering, or Mathematics (STEM).
• Knowledge of machine learning concepts and their application to reasoning and problem‑solving.
• Proficient in Python, Perl, or another scripting language.
• Experience in an ML or data scientist role with a large technology company.
• Experience defining and creating benchmarks for assessing GenAI model performance.
• Experience working on multi‑team, cross‑disciplinary projects.
• Experience applying quantitative analysis to solve business problems and making data‑driven decisions.
• Strong written and verbal communication skills, effectively conveying complex concepts.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Base salary range: $136,000 – $184,000 annually. Compensation also includes sign‑on payments and restricted stock units (RSUs). Amazon offers comprehensive benefits such as health insurance, 401(k) matching, paid time off, and parental leave.