Sr Data Engineer

Sr Data Engineer Req :

Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all working to build and advance the technological backbone for Disney’s media business globally. The team marries technology with creativity to build world‑class products, enhance storytelling, and drive velocity, innovation, and scalability for our businesses. We are storytellers and innovators.

Creators and builders. Entertainers and engineers. We work with every part of The Walt Disney Company’s media portfolio to advance the technological foundation and consumer media touch points serving millions of people around the world.

In this role, you will help build the future of Disney’s media by designing, building, and testing robust data solutions that measure Disney+ product performance. You will work with Scala, Python, Spark, Databricks, Airflow, Delta Lake, Snowflake, Git Hub Actions, and Jenkins to develop reliable data pipelines and models that examine browse, playback attribution, and search data. Your work will create governed, source‑of‑truth datasets essential for measuring Disney+ engagement and driving critical business decisions.

• Design, implement, and deploy robust data solutions for batch ingestion and stream processing using Scala and Python with frameworks like Spark, primarily deployed via Databricks and Airflow.
• Establish and enforce rigorous standards for code development, testing, and deployment to guarantee the highest levels of data quality, accuracy, and governance.
• Extend functionality of Product Performance Data offerings by evolving existing data models and developing new data pipelines to introduce novel metrics and dimensions critical for measuring Disney+ engagement.
• Maintain, update, and expand existing source code that powers core datasets, ensuring strict quality standards and high data reliability.
• Drive platform and business success through active collaboration with Product Managers, Data Analysts, and cross‑functional engineering teams to define requirements and deliver new data features.
• Work within a modern data and engineering tech stack, including Airflow, Spark, Databricks, Delta Lake, Snowflake, Git Hub Actions, and Jenkins.
• Proactively investigate and resolve complex data pipeline failures and quality issues, performing root cause analysis, and creating comprehensive documentation to ensure data integrity and support operational efficiency.
• Identify and implement technical optimizations to improve performance, scalability, and cost‑efficiency of existing data pipelines, while providing technical guidance and mentorship on best practices.

• 5+ years of software engineering experience developing large data pipelines.
• Strong CI/CD and SDLC fundamentals.
• Strong algorithmic problem‑solving expertise.
• Strong fundamental Scala and Python software engineering skills.
• Basic understanding of AWS or other cloud provider resources (S3).
• Strong SQL skills and ability to create queries to analyze complex datasets.
• Hands‑on production environment experience with distributed engineering systems such as Spark and Kafka.
• Hands‑on production experience with orchestration systems such as Airflow.
• Some scripting language (Bash, Power Shell) experience.
• Willingness and ability to learn and pick up new skillsets.
• Self‑starting problem solver with an eye for detail and excellent analytical and communication skills.

• Master’s Degree in Computer Science, Information Systems preferred.
• Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query).
• Experience with Jenkins and Git Hub Actions.
• Experience in developing APIs with Graph
  
  QL.
• Deep understanding of AWS or other cloud providers as well as infrastructure as code.
• Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices.
• Familiar with Scrum and Agile methodologies.

Required

Education:

Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.

Hiring range for this position in New York, NY is $148,700 to $199,400 per year. The base pay actually offered will take into account internal equity and may vary depending on the candidate’s geographic region, job‑related knowledge, skills, and experience. A bonus and/or long‑term incentive units may be provided as part of the compensation package, in addition to medical, financial, and/or other benefits, dependent on the level and position offered.

Employment Type:

Full time.

Location:

New York, NY, USA.