Data Engineer

Data Engineering (AWS + Snowflake)

Location:

Chennai

Position Overview

We are seeking an experienced Associate Director of Data Engineering to lead our AWS and Snowflake-based data platform initiatives. This role combines deep technical expertise with strong delivery management capabilities, requiring a hands-on leader who can architect scalable solutions while managing cross-functional teams to successful implementation.

Key Responsibilities

Solutioning & Architecture:

- Design and architect end-to-end data engineering solutions leveraging AWS services (S3, Glue, EMR, Lambda, Kinesis, Redshift) and Snowflake
- Experience in implementing Data Vault is desired
- Define data lake and data warehouse architectures that support enterprise-scale analytics and business intelligence requirements
- Develop data integration strategies, ETL/ELT frameworks, and data pipelines using modern engineering practices
- Establish data governance frameworks, security protocols, and compliance standards across cloud platforms
- Evaluate emerging technologies and recommend innovative approaches to optimize data infrastructure

Delivery Management:

- Lead multiple concurrent data engineering projects from initiation through deployment and post-production support
- Manage project timelines, resources, budgets, and stakeholder expectations across complex implementations
- Coordinate with business stakeholders, data scientists, analysts, and engineering teams to ensure alignment with business objectives
- Implement Agile/Scrum methodologies and drive continuous improvement in delivery processes
- Manage risks, dependencies, and impediments to ensure on-time, high-quality deliverables

Team Leadership:

- Build, mentor, and develop a high-performing team of data engineers and technical specialists
- Provide technical guidance and code reviews to ensure best practices and quality standards
- Foster a culture of innovation, collaboration, and continuous learning within the team
- Conduct performance evaluations and support career development initiatives

Technical Delivery:

- Hands-on involvement in complex technical implementations including data modeling, pipeline development, and performance optimization
- Ensure scalability, reliability, and performance of data platforms supporting petabyte-scale data processing
- Implement Data Ops practices including CI/CD pipelines, automated testing, and monitoring frameworks
- Troubleshoot production issues and implement preventive measures

Required Qualifications

- Bachelor's or master’s degree in computer science, Engineering, or related technical field
- 15+ years of experience in data engineering with at least 3 years in leadership roles
- Strong expertise in AWS cloud services (S3, Glue, EMR, Lambda, Athena, Kinesis, Step Functions, Lake Formation)
- Extensive hands-on experience with Snowflake including architecture, optimization, and SnowSQL
- Proficiency in programming languages such as Python, SQL, and Scala/Java

- Experience with infrastructure-as-code tools (Terraform, Cloud Formation)
- Proven track record of delivering large-scale data platform projects in enterprise environments
- Strong understanding of data warehousing concepts, dimensional modelling, and ETL/ELT patterns

- Experience with big data technologies (Spark, Hadoop, Kafka)
- Demonstrated ability to translate business requirements into technical solutions

Preferred Qualifications

- Domain experience – Wealth Management/Capital Markets
- AWS certifications (Solutions Architect, Data Analytics, or similar)
- Snow Pro certifications (Core or Advanced)

- Experience with data governance tools (Collibra, Alation, AWS Glue Data Catalog)
- Knowledge of streaming data architectures and real-time processing
- Familiarity with dbt (data build tool) and modern data stack components

- Experience with Data Ops and MLOps practices
- Strong presentation and stakeholder management skills
- PMP, Scrum Master, or similar project management certifications