Lead Data Engineer

Location: Vasanthanagar

Job Description
Value Preposition
Lead the development and maintenance of large-scale data platforms, data lakes and cloud solutions.
Responsible for designing and building data pipelines for enterprise data through ETL/ELT processes.

Job Details

Position Title:

Lead Data Engineer

Career Level:

P3
Job Category:
Manager
Role Type:
Hybrid

Job Location:

Bangalore

About the Team:
The data engineering team is community of dedicated professionals committed to designing, building, and maintaining data platform solutions for the organization.

Impact
Enterprise data warehouse supports several critical business functions for the bank including Regulatory Reporting, Finance, Risk steering, and Customer 360. This role is vital for building and maintaining enterprise data platform, data processes, and to support business objectives. Our values — inclusivity, transparency, and excellence — drive everything we do. Join us and make a meaningful impact on the organization.

Key Deliverables
Responsible for designing, building, and maintaining data platform that supports data integrations for Enterprise Data Warehouse, Operational Data Store or Data Marts etc. with appropriate data access, data security, data privacy and data governance.
Establish enterprise-scale data integration procedures, data pipelines and frameworks across the data development life cycle. Suggest and implement appropriate technologies to deliver resilient, scalable, and future-proof data solutions.
Create data ingestion pipelines in data warehouses and other large-scale data platforms.
Creating scheduled as well as trigger-based ingestion patterns using scheduling tools.
Create performance optimized DDLs for any row-based or columnar databases such as Oracle, Postgres, Netezza database per Logical Data Model.
Performance tuning of complex data pipelines and SQL queries.
Performs impact analysis of proposed changes on existing architecture, capabilities, system priorities, and technology solutions.
Manage deliverables of developers, perform design reviews and coordinate release management activities.
Estimate and provide timelines for project activities. Identify, document, and communicate technical risks, issues and alternative solutions discovered during project.
Drive automation, identify inefficiencies, optimize processes and data flows, and recommend improvements.
Use agile engineering practices and various data development technologies to rapidly develop and implement efficient data products.
Collaborate with Product Owners to understand PI goals, PI planning, requirement clarification, and delivery coordination.
Technical support for production incidents and failures
Work with global technology teams across different time zones (primarily US) to deliver timely business value.

Skills and Qualification
Functional

Skills:

Team Player:
Support peers, team, and department management.
Communication:
Excellent verbal, written, and interpersonal communication skills.
Problem Solving:
Excellent problem-solving skills, incident management, root cause analysis, and proactive solutions to improve quality.
Partnership and

Collaboration:

Develop and maintain partnership with business and IT stakeholders
Attention to Detail:
Ensure accuracy and thoroughness in all tasks.

Technical/Business

Skills:

Data Engineering:
10+ years  of experience in designing and building Data Warehouse and Data lakes. Good knowledge of data warehouse principles, and concepts.
Technical expertise working in large scale Data Warehousing applications and databases such as Oracle, Netezza, Teradata, and SQL Server.
Cloud-based data platform experience especially  Snowflake  and AWS.
Data integration skills:
Expertise in design and development of complex data pipelines
Solutions using any industry leading ETL tools such as  IBM Data Stage  or SSIS or  SAP Business Objects Data Services (BODS)

Experience with Unix, Python or equivalent scripting language
Basic knowledge of Transform/ELT tools such as  DBT , Qlik Replicate,  AWS Glue  or  Snowpark , etc.
Expert in SQL , stored procedures and adept in tracing and resolving data integrity issues.
Strong knowledge of data architecture, data design patterns, modeling
Data Model :
Expertise in Logical and Physical Data Model using Relational, Dimensional or Data Vault Modeling practices with high volume ETL/ELT processes.
Good experience with scheduling tools such as Control-M
Performance tuning of data pipelines and DB Objects to deliver optimal performance.
Experience in Gitlab version control and CI/CD processes.
Experience working in Financial Industry is a plus.

Relationships & Collaboration

Reports to:

Associate Director - Data Engineering
Partners:
Senior leaders and cross-functional teams
Leads: A team of Data Engineering associates

Accessibility Needs
We are committed to providing an inclusive and accessible hiring process. If you require accommodations at any stage (e.g. application, interviews, onboarding) please let us know, and we will work with you to ensure a seamless experience.