Research Engineer, Prime Video - Content Understanding

Description

Prime Video is looking for a Research Engineer to support scientific research efforts in our Content Reasoning, Enrichment and Localization team. We build and deploy Generative AI models across Prime Video Lines of Business, including Derivative Content, Trust & Safety, and Metadata Localization. A Research Engineer supports Applied Scientists on the team by building experiment frameworks, infrastructure and deployment packages. A Research Engineer may be called to directly facilitate science benchmarking, model training, model deployment, and deep dive on any deep learning related technical problem.

This person may be called to lead or facilitate a joint project between science and engineering team. This role would be responsible for end-to-end ownership of model training and deployment, from managing our GPU cluster, to monitoring job queues, and containerizing trained for deploying models into production. This role will support several research teams with remits across lines of business and machine learning methodologies.

Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports - including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+.

All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads.

Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience.

As a Prime Video technologist, you'll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You'll get to work on projects that are fast-paced, challenging, and varied. You'll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people.

We'll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you!

Key job responsibilities

Cluster Management

* Architect and operate SLURM cluster infrastructure for distributed training and evaluation workloads

* Maintain healthy job status and manage queues from different users and teams

* Monitor feedback regarding cluster features and functions

* Identify and drive infrastructure optimization opportunities

* Develop self-service tooling, automation, and APIs

Model Deployment

* Gather requirements from collaborators on research teams

* Containerize Machine Learning Models

* Shepherd models through deployment into beta environments, including debugging builds

* Develop data collection, aggregation and monitoring pipelines

* Build observability and monitoring systems or dashboards for ML infrastructure

About the team

This team's mission is to deeply understand all content and empower customers with relevant language options, innovative accessibility assists, and rich title-information across all their content experiences on Prime Video. We delight our customers by pushing the boundaries of content understanding and enrichment. Through inclusion and innovation, we do the most fulfilling work of our career.

Basic Qualifications

- Experience in automating, deploying, and supporting large-scale infrastructure

- Experience programming with at least one modern language such as Python, Ruby, Golang, Java, C++, C#, Rust

- Experience with Linux/Unix

- Bachelor's degree, or 2+ years of working with Advanced Compute technologies including, but not limited to:
Accelerated Compute, High Performance Compute, Visual/Spatial Compute, and/or IoT. experience

- 3+ years of cloud computing technologies experience

- Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware, or experience leading the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems

Preferred Qualifications

- Experience with distributed systems at scale

- Master's degree

- Experience with large scale machine learning systems such as profiling and debugging and understanding of system performance and scalability

- Publications or contributions to open-source HPC projects

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including…