Lead Data Engineer

Responsibilities

• Design, develop, and run tooling to discover problems in data and applications and report the issues to engineering and product leadership
• Review and analyze complex software enhancement initiatives for business, operational or technical improvements that require in depth evaluation of multiple factors including intangibles or unprecedented factors
• Make decisions in complex and multi-faceted data engineering situations requiring understanding of software package options and programming language and compliance requirements that influence and lead Technology to meet deliverables and drive organizational change
• Create standardized feature transformation pipelines and a common feature store with strong lineage, dictionary and high availability for models
• Implement robust data modeling (dimensional, data vault, or canonical models)
• Enforce data quality, lineage, and observability using standardized metrics, validation rules, and monitoring dashboards.
• Document patterns, runbooks, and best practices, and provide enablement through workshops and code examples

• 5+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
• 5+ years of Data Engineering experience
• 5+ years of experience designing ETL(SSIS/WF Developed Spark Flow/ADF), DBMS(SQL Server/Azure SQL/Oracle/Teradata), Python(Programming language)
• 5+ years of Advanced T-SQL(complex queries, stored procedures, functions, index)