Lead Data Engineer - Tax Product Development Job Rochester area,City of Rochester New York USA,Software Development

Location: City of Rochester

The Lead Data Engineer, Tax Product Development, works with the Data Engineering and Integration team to develop and support BDO's Tax Data Warehouse and Tax Data Lake, manage and maintain data ingestion and Extract/Transform/Load (ETL) processes, as well as provide support for the Power BI business intelligence platform and enterprise applications supporting the tax practice.

The Lead Data Engineer builds and maintains tax data pipelines to support ad-hoc analytics and business intelligence applications as well as identify valuable development opportunities and ideas for improvement. This role collaborates closely with the data analytics teams to design, develop, and deploy new solutions that support strategic business priorities.

Job Duties:

Owns end-to-end delivery of large features and systems, defining technical requirements and architecture for data processing and integration solutions
Leads design and implementation of major data structures and pipelines within an Agile team focused on data engineering solutions
Designs, develops, and tests data products, pipelines, and solutions using web and cloud technologies for innovative data processing and analytics
Applies modern software engineering principles throughout the software lifecycle for data-related applications, including ETL/ELT processes and database systems
Reviews business requirements for technical feasibility, and collaborates with various teams, including internal developers and external peers, to deliver quality data integration solutions
Mentors junior engineers to enhance code quality and ensure compliance with standards in data pipeline and analytics platform development
Maintains data products and platforms based on product roadmaps, production support processes, and compliance with IT, security, and business mandates, ensuring data consistency, integrity, and scalability
Effectively communicates with stakeholders and cross functional teams such as technical architects and security teams and others
Other duties as required

Supervisory Responsibilities:

Acts as a direct supervisor to team members, as assigned
Acts as a career advisor, as assigned

Qualifications, Knowledge, Skills, and Abilities:

Education:

Bachelor's degree required; focus in Computer Science, Technology, Engineering, Mathematics (STEM), Finance, or Accounting, preferred

Experience:

Six (6) or more years of experience in a data engineer or related role, required
Hands-on experience architecting, building, and optimizing large-scale relational (e.g., SQL Server, PostgreSQL, Oracle) and non-relational (e.g., CosmosDB, MongoDB, Cassandra, DynamoDB) databases to support both OLTP and OLAP workloads, preferred
Experience writing and optimizing complex queries, stored procedures, functions, and triggers using SQL and comparable languages for high-volume transactional systems and analytical platforms, preferred
Data Definition Language (DDL) and Data Manipulation Language (DML), with experience developing and maintaining database objects (tables, views, indexes, partitions) at scale, preferred
Experience with data modeling principles, including normalization, denormalization, star and snowflake schema design, and semantic layer construction for enterprise data warehouses and data lakes, preferred
Experience with design and implement ETL/ELT pipelines using modern data engineering frameworks and tools (e.g., Apache Spark, Databricks, Airflow, Talend, Informatica), preferred
Experience implementing data governance, data quality, and data security best practices in large, distributed environments, preferred
Public accounting experience, preferred

Software:

One or more programming languages such as Python, Java, C#, C++, or Scala, with a focus on data engineering applications, required
Experience with the following products, preferred:
- Microsoft Office Suite
- Microsoft Azure Dev Ops or Git Hub
- Microsoft SQL Server and/or Azure SQL DB

Other Knowledge, Skills, & Abilities:

Ability to work well in hybrid and remote environments
Solid verbal and written communication skills
Strong interpersonal and customer relationship skills, including training/instruction with professionals at all levels
Sound decision-making skills
Ability to work in a deadline-driven environment while handling multiple complex projects/tasks simultaneously with a focus on details
Capable of successfully multi-tasking while working independently or within a group environment
Ability to rely on extensive experience and judgment to plan and accomplish goals
Capable of working well under pressure while dealing with unexpected problems in a professional manner

#J-18808-Ljbffr