Data Engineer III

Responsibilities

• Develops, tests, and maintains complex prioritized engineering (design/build/test) work as a member of a data analytics product pipeline architecture and infrastructure team
• Investigates and analyzes feasibility of data integration prototypes and program requirements
• Develops specifications and plans the full range of programming actions to produce data integration components
• Develops and maintains complex automated ETL/ELT pipeline architecture that cleans, transforms, and aggregates data from disparate sources using architecturally approved tools, programming languages, and services to deliver a data mesh approach
• Develops and maintains complex automated ETL/ELT monitoring and alarming solutions using architecturally approved languages and services
• Monitors, troubleshoots, and optimizes data pipelines for quality, performance, and reliability creating a single source of truth providing business customers with highly reliable and quality data
• Builds complex unit tests to enable test driven development and automation to drive code reliability
• Develops, maintains, tests, and deploys code with architecturally approved toolsets using Dev Ops practices, ETL/ELT pipelines, data catalogs and data queries
• Maintains data solutions in a divest state to ensure business functionality until replaced with new technology
• Balances and designs data analytics product solutions based on cost and performance to meet data needs and business requirements
• Guides business customers to develop, troubleshoot, and optimize complex SQL and ETL/ELT solutions to solve reporting, metrics, and analytics problems
• Collaborates with cross-functional teams to understand data requirements for data analytics products and translate them into scalable and efficient data solutions

• Bachelor’s degree, preferably in a computer related field or equivalent relevant experience
• Five years of data integration development experience, or related experience
• Strong SQL knowledge and experience working with relational databases
• Excellent analytical skills to work with unstructured datasets
• Excellent knowledge of applicable programming languages, such as Python
• Strong knowledge of cloud services such as RDS, S3, SNS, Cloud Watch and Lambda
• Strong knowledge of DBT/Informatica or other ETL/ELT tools preferred
• Strong knowledge of Snowflake
• Strong knowledge of data modeling
• Excellent ability to build processes supporting data transformation, data structures, metadata, dependency and workload management
• Strong ability to manipulate, process and extract value from large, disconnected datasets
• Strong knowledge of Dev Ops and/or Data Ops practices, CI/CD pipelines, and containerization technologies preferred
• Excellent knowledge of orchestration or scheduling tools
• Excellent verbal and written communication skills
• Strong attention to detail, organizational and multi-tasking skills with the ability to adapt to changing priorities
• Ability to maintain confidentiality.