More jobs:
Job Description & How to Apply Below
We are hiring for a Data Engineer :
Experience:
5 to 10 years .
Location:
Pune
5-10 years of data engineering experience, including 3+ years of hands-on Databricks experience.
Hands-on experience with Azure Databricks, including notebooks, workflows, jobs, and pipeline development.
Strong proficiency in PySpark, Spark SQL, Python, and SQL.
Experience with Delta Lake, Delta Live Tables (DLT), Auto Loader, Lakeflow, and Structured Streaming.
Strong understanding of Medallion Lakehouse architecture, ETL/ELT pipeline engineering, data ingestion, data quality, monitoring, logging, and performance optimization.
Experience with Unity Catalog, RBAC, data governance, lineage, and access control.
Ability to optimize Spark workloads using partitioning, caching, cluster sizing, and query tuning.
Good understanding of security, identity and access management, compliance, and governance.
Experience with Azure Data Factory (ADF), Integration Runtime, ADLS Gen2, Airflow, Azure SQL, Key Vault, Logic Apps, Event Grid, Azure VMs, Bicep, VNet, and Private Endpoints.
Experience with Azure Dev Ops, Git, CI/CD, and environment management.
Good communication and collaboration skills.
Good-to-have exposure to GenAI workloads on Databricks.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×