Mid-Senior Databricks Engineer
-
Software Development
Job Description & How to Apply Below
Arting Digital Private Limited | Full time
Position: Mid-Senior Databricks Engineer
Location: Remote
Experience: 3–6 Years
Employment Type: Full-Time
RequiredSkills & Qualifications
3–6 years of experience in Data Engineering.
Strong knowledge of SQL, Python, and PySpark.
Hands-on experience with Databricks and Apache Spark.
Understanding of Spark optimization, partitioning, and shuffling.
Experience with Delta Lake, Z-Ordering, and VACUUM.
Knowledge of Apache Airflow or Azure Data Factory.
Understanding of data governance and data quality.
Key ResponsibilitiesDevelop and maintain scalable data pipelines using Databricks, Python, and PySpark.
Build and automate ETL workflows using Delta Live Tables (DLT).
Optimize Spark jobs through partitioning, shuffling, and performance tuning.
Implement Delta Lake optimization techniques, including Z-Ordering and VACUUM.
Manage data orchestration using Airflow or Azure Data Factory.
Ensure data quality, governance, and pipeline performance.
Collaborate with cross-functional teams to deliver efficient data engineering solutions.
Position Requirements
10+ Years work experience(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction