Senior Data Engineer

Location: Vasanthanagar

Looking for a Data Engineering professional to work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. You will be building, optimizing, and maintaining large data pipelines and warehouse infrastructure in this role.

Key Responsibilities
Minumum 5 years of experince in Data Engineering.
Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
Implement data ETL processes for batch and streaming analytics requirements.
Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
Ensure data security, integrity, and compliance throughout the infrastructure.
Maintain documentation and contribute to architecture reviews.
Participate in incident response and operational excellence initiatives for the data warehouse.
Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.

Required Skills
Snowflake Architecture, Snowpipe, Streams & Tasks, Virtual Warehouses.
SQL, Python, PySpark.
ETL/ELT Development and CDC.
dbt.
Medallion Architecture.
Dimensional Modeling and SCD Type 1 & Type 2.
SAP HANA to Snowflake migration experience.
AWS/Azure/GCP knowledge.
Git, Azure Dev Ops, Jira, Confluence.
Strong analytical and stakeholder management skills.

Preferred Qualifications
Bachelor's degree in Computer Science, IT, Engineering, or related field.
Enterprise-scale Snowflake implementation experience.
Snow Pro Core Certification.
Cloud certifications (AWS/Azure/GCP).
Agile/Scrum experience.
Nice to Have
Snowpark
AI/ML Data Engineering
LLMs, Prompt Engineering, RAG
Data Ops / CI-CD Pipelines

Experience with globally distributed teams