Lead Data Engineer – Databricks, Microsoft Fabric, Snowflake & Azure

Employment Type:
Full-Time (W2 Only)

Location:
USA (Hybrid / Onsite)

We are seeking an experienced Lead Data Engineer with strong hands-on expertise in Databricks, Microsoft Fabric, Snowflake, Azure Synapse, Azure Data Factory, and Power BI to design, develop, and deliver scalable enterprise data platforms. The ideal candidate will have strong experience in ETL/ELT, Lakehouse Architecture, Data Warehousing, PySpark, SQL, Data Modeling, Delta Lake, and Cloud Data Engineering
, along with proven technical leadership capabilities.

• Lead the design and development of scalable ETL/ELT pipelines, Data Lake, Lakehouse, and Data Warehouse solutions
  .
• Develop and optimize data pipelines using Azure Databricks, PySpark, Python, SQL, Microsoft Fabric, Azure Data Factory (ADF), and Azure Synapse Analytics
  .
• Design, develop, and optimize Snowflake Data Warehouse solutions and analytical data models.
• Implement Delta Lake, Medallion Architecture, CDC, incremental data processing, schema evolution, and data quality frameworks
  .
• Build curated datasets, semantic models, and analytical data layers supporting Power BI reporting and enterprise analytics
  .
• Optimize Spark jobs, SQL queries, data pipelines, cluster utilization, storage, and cloud costs
  .
• Implement data integration solutions across Azure services, Snowflake, Databricks, Microsoft Fabric, and enterprise source systems.
• Develop batch and near real-time data processing solutions using modern cloud data engineering technologies.
• Implement CI/CD pipelines, Git-based development, automated deployments, monitoring, logging, and production support
  .
• Establish data governance, security, lineage, metadata, and access-control best practices.
• Conduct code reviews, architecture discussions, technical design sessions, and mentor Data Engineers.
• Collaborate with Data Architects, BI Developers, Data Scientists, Business Analysts, and business stakeholders to deliver enterprise data solutions.

• 8–12+ years of Data Engineering experience.
• Strong hands-on expertise in Databricks, PySpark, Python, and SQL
  .
• Strong experience with Microsoft Fabric, One Lake, Fabric Data Factory, Fabric Lakehouse, and Fabric Warehouse
  .
• Strong hands-on Snowflake experience including data warehousing and analytical workloads.
• Experience with Azure Synapse Analytics and Azure Data Factory (ADF).
• Strong understanding of Power BI, Semantic Models, Data Modeling, and DAX
  .
• Hands-on experience with Delta Lake, Lakehouse Architecture, Medallion Architecture, CDC, and incremental processing
  .
• Experience with Azure cloud services, CI/CD, Git, Dev Ops, data governance, and production support
  .
• Strong understanding of ETL/ELT, Data Warehousing, Data Lakes, Data Integration, and Distributed Data Processing
  .
• Strong communication, problem-solving, technical leadership, and stakeholder management skills.

• Unity Catalog
• Fabric Lakehouse / Fabric Warehouse
• Snowflake Streams & Tasks
• Microsoft Purview
• Terraform
• Git Hub Actions
• Spark Structured Streaming
• Experience with Data Quality, Data Lineage, Metadata Management, and Data Governance

• W2 Full-Time Only
• No C2C
• No Third-Party Vendors or Consultancy Profiles