Data Engineer II

Overview

Yahoo Mail is the ultimate consumer inbox with hundreds of millions of users. It is the best way to access your email and stay organized from a computer, phone or tablet. With its beautiful design and lightning fast speed, Yahoo Mail makes reading, organizing, and sending emails easier than ever.

The Mail Analytics Infrastructure & Data Engineering team at Yahoo is responsible for building mission critical data serving, pipelines, lakehouse, analytics systems and infrastructures for the Yahoo Mail business. We are constantly pushing the envelope of data & analytics platforms due to the massive volume of data we need to harness in order to drive the explosive growth of AI advances.

As part of the Mail Analytics Infrastructure & Data Engineering team, you will be working on large-scale batch pipelines, data serving, data lakehouse, and analytics systems, enabling mission critical decision making, downstream, AI-powered capabilities, and more.

• Develop new or improve and maintain existing large-scale data infrastructures and systems for data processing or serving, optimizing complex code through advanced algorithmic concepts and in-depth understanding of underlying data system stacks
• Create and contribute to frameworks that improve the efficacy of the management and deployment of data platforms and systems, while working with data infrastructure to triage and resolve issues
• Prototype new metrics or data systems
• Define and manage Service Level Agreements for all data sets in allocated areas of ownership
• Develop complex queries, very large volume data pipelines, and analytics applications to solve analytics and data engineering problems
• Collaborate with engineers, data scientists, and product managers to understand business problems, technical requirements to deliver data solutions
• Engineering consulting on large and complex data lakehouse data

• BS in Computer Science/Engineering, relevant technical field, or equivalent practical experience, with specialization in Data Engineering
• 3-5 years of experience in Data Engineering (ETL, data lakehouse, Data Modeling)
• Strong fundamentals: algorithms, distributed computing, data structure, database, data warehouse
• Fluency with:
  Python/Java/SQL
• Self-driven, challenge-loving, detail oriented, teamwork spirit, excellent communication skills, ability to multitask and manage expectations

• MS/PhD in Computer Science/Engineering or relevant technical field, with specialization in Data Engineering
• 2+ years experience in Hadoop/Apache technologies (Pig, Hive, HBase, Storm, Spark, Kafka, Oozie)
• 2+ years experience in Google Cloud Platform technologies (Big Query, Dataproc, Dataflow, Composer, Looker)

The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity.

At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don't require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You'll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter!

Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law.

Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable…