Lead Data Engineer

About the Company:

Everest DX – We are a Digital Platform Services company, headquartered in Stamford. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterprise IT. Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and actionable insights through an integrated set of futuristic digital technologies.

Digital Transformation Services - Specialized in Design, Build, Develop, Integrate, and Manage cloud solutions and modernize Data centers, build a Cloud-native application and migrate existing applications into secure, multi-cloud environments to support digital transformation. Our Digital

Platform Services enable organizations to reduce IT resource requirements and improve productivity, in addition to lowering costs and speeding digital transformation.

Digital Platform - Cloud Intelligent Management (CiM) - An Autonomous Hybrid Cloud Management Platform that works across multi-cloud environments. helps enterprise Digital Transformation get most out of the cloud strategy while reducing Cost, Risk and Speed.

To know more please visit:

Job Title:

Azure Data Engineer / Lead

Location:

Hyderabad (Work from Office)

Experience:

6–12 Years

Job Summary:

We are seeking an experienced Azure Data Engineer / Lead with strong expertise in Azure services, distributed data processing, and team leadership. The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Lake, Azure Data Factory, PySpark/Spark, and SQL, along with the ability to guide a small team on technical design and delivery.

Key Responsibilities:

- Design, develop, and optimize large-scale data pipelines using Azure Databricks, ADLS, and ADF.
- Implement and manage distributed data processing solutions using Spark/PySpark.
- Write and optimize SQL queries for data extraction, transformation, and analysis.
- Lead and mentor a small team of data engineers, providing technical guidance and reviewing design solutions.
- Collaborate with stakeholders to translate business requirements into scalable and efficient data solutions.
- Ensure data quality, governance, and compliance across data platforms.
- Support production deployments, troubleshooting, and performance optimization.

Required Skills:

- Strong expertise with Azure Databricks, Azure Data Lake, and Azure Data Factory.
- Hands-on experience in Spark/PySpark for distributed data processing.
- Proficiency in SQL for complex queries and optimization.
- Solid understanding of Azure cloud platform and its ecosystem.
- Proven experience in leading and mentoring teams.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.