Senior Data Engineer

HCLTech is looking for a highly talented and self-motivated Senior Technical Lead – Data Engineering to join it in advancing the technological world through innovation and creativity.

Job Title: Senior Technical Lead – Data Engineering

Job : 149322

Position Type: Full-time

• Lead and provide technical direction to data engineering teams responsible for implementing solutions using Snowflake, Azure Data Factory (ADF), and Azure Databricks
  .
• Design, develop, implement, and maintain scalable and reliable data pipelines to support business and analytics requirements.
• Develop and optimize ETL/ELT processes using Azure Data Factory, Databricks, and Snowflake.
• Design effective data models and implement data solutions in Snowflake, including query and performance optimization.
• Develop data processing solutions using Azure Databricks to support data engineering, analytics, and related workloads.
• Work closely with business stakeholders, data architects, analysts, application teams, and other technical teams to understand requirements and translate them into effective data solutions.
• Identify opportunities to improve data integration, data quality, data processing, and analytics capabilities.
• Monitor data pipelines and data-processing workflows, troubleshoot issues, and implement solutions to ensure reliability, performance, and data quality.
• Analyze and resolve complex technical issues related to data pipelines, integration processes, processing failures, and performance bottlenecks.
• Collaborate with cross-functional teams to integrate data solutions with existing applications, platforms, and enterprise systems.
• Establish and promote data engineering best practices, coding standards, development methodologies, and performance optimization techniques.
• Provide technical expertise, guidance, and mentorship to team members, fostering continuous learning and innovation.
• Participate in Agile ceremonies, sprint planning, technical discussions, estimation, and project execution activities.
• Stay current with emerging technologies, tools, and best practices in cloud data engineering, data management, analytics, Snowflake, Azure, and Databricks.
• Support successful project delivery by coordinating technical activities, managing priorities, identifying risks, and ensuring solutions meet defined business and technical requirements.
• Preferably an undergraduate / associate-level degree / diploma from an accredited institution in Computer Science, Information Technology, Engineering, Data Science, or a related technical field. Equivalent technical education and relevant professional experience may also be considered.
• Strong hands-on experience with Snowflake
  , including data modeling, SQL querying, data processing, and performance optimization.
• Strong hands-on experience with Azure Data Factory (ADF) for data integration, ETL/ELT, workflow orchestration, and pipeline development.
• Hands-on experience with Azure Databricks for data engineering, data processing, transformation, and analytics workloads.
• Demonstrated experience designing, developing, maintaining, and optimizing complex data pipelines.
• Strong understanding of ETL/ELT processes and modern cloud-based data engineering practices.
• Experience troubleshooting data pipeline failures, data-quality issues, performance bottlenecks, and integration challenges.
• Strong SQL and data-engineering skills with the ability to work with large and complex datasets.
• Ability to collaborate effectively with technical and non-technical stakeholders and translate business requirements into technical solutions.
• Strong technical leadership skills with experience providing guidance, mentoring, and support to technical team members.
• Strong analytical and problem-solving skills with the ability to independently investigate and resolve complex technical issues.
• Experience working in Agile development environments and familiarity with project management and software development practices.
• Excellent written and verbal communication skills.

• Relevant certifications in Snowflake, Microsoft Azure, Azure Data Factory, or Databricks
  .
• Experience implementing enterprise-scale cloud data…