Databricks Resident Consultant

Looking for Experienced Databricks Resident consultants having prior working experience on Databricks Data Engineering. The candidate will be responsible for setting up Databricks Work spaces, creating Delta Lakes, Writing declarative ingestion pipelines & utilizing databricks data quality frameworks (constraints) to delivery high quality Data Pipelines.

The role will be customer facing and will require unique problem solving, stakeholder management & thought leadership qualities.

• Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices.
• Should have worked on atleast 2 Data warehouse Migration engagements in Past (Preferably one on Databricks, but can be non databricks migration also).
• Should have prior experience of Dimensional Data Modelling on tools like Erwin Modeller etc.
• 5+ years of hands‑on experience in data engineering, with at least 2+ years in Databricks Architect and Apache Spark.
• Proficient in Cluster Management & Workspace Organisation.
• Proficient in Delta Lake Framework, Databricks Work spaces and Unity Catalog.
• Proficient in writing ETL Pipelines on Databricks by using Delta Live Tables for Streaming , Batch & Incremental Batch ingestion features.
• Comfortable architecting & writing code in either Python and SQL.
• Should have excellent understanding of Apache Spark Job Performance Tuning, Partitions Optimization etc.
• Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one.
• Deep experience with distributed computing with Apache Spark and knowledge of Spark runtime internals.
• Familiarity with CI/CD for production deployments.
• Working knowledge of MLOps.
• Design and deployment of performant end‑to‑end data architectures.
• Experience with technical project delivery – managing scope and timelines.
• Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects.

• Databricks Certified Associate Developer for Apache Spark.
• Databricks Certified Professional Data Engineer.
• Cloud Certifications (AWS Certified Solutions Architect, Azure Solutions Architect Expert).