Sr Data Engineer

Sr Data Engineer

The Senior Data Software Engineer will create data ingestion pipelines including workloads and applications inside AWS. Implements, troubleshoots, and optimizes distributed solutions based on big data technologies like SQL, S3, Glue, MSK, Snowflake and Redshift to solve large scale processing problems in a Cloud DW environment. Designs syndicated and curated data views that will be used for reporting, analytics, and advanced applications.

Apply technical expertise and mathematical concepts to challenging programming problems. Strong communication, interpersonal, and collaboration skills, including the ability to work effectively in an agile / scrum environment.

• Design and develop data pipelines in AWS & Snowflake
• Design and develop data views, assist with architecture decisions, deployment, and feedback.
• Strong knowledge and practical experience with AWS Services (CDK, Cloud Formation, Kinesis, Lambda, SQS, SNS, S3, EC2)
• Ability to debug and troubleshoot across a broad technical stack.
• Product ownership and strong business support in enterprise level theme park related environment.
• Working with a variety of business partner groups across Disney Parks and Resorts to implement optimal technical solutions.
• Provide data and system analysis needed for feature engineering.

• Minimum of 5 years of experience in data engineering with SQL in a Data Warehouse environment
• Strong knowledge of Python and object-oriented programming concepts.
• Experience building data pipelines and complex data transformations.
• 5+ years of experience with AWS S3, Glue, MSK, Redshift, Spark, and related tools
• Solid working experience with Snowflake native objects like Snow Pipe, external/internal stages, external tables, integration objects, stored procedures (Snowflake Scripting), stream & task, data masking, time travel and cloning.
• Working knowledge of Data Build Tool (DBT)
• 5+ years of experience in software development in an agile environment.
• Production experience with Dev Ops Tools like Terraform or CDK.
• Strong conceptual understanding of security at rest and in transit for big data pipelines.
• Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in complex situations.
• Strong systems and data analysis skills, and experience with testing in data space.
• Strong domain knowledge of ticketing and entitlement systems. Hands-on experience with architecture, design, data models, eventing infrastructure, and implementation details.

• Bachelor’s Degree in Computer Science, Distributed Computing, Machine Learning, Mathematics or related field

The hiring range for this position in California is $ to $ per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and other benefits, dependent on the level and position offered.