Databricks Developers

Job Description Databricks Developers Role Summary

We are looking for a Databricks Developer with strong expertise in SQL, Python, Apache Spark, data pipelines, analytics, reporting, and AI workloads
. The role focuses on building scalable data solutions on the Databricks platform to support enterprise analytics, reporting, and AI/ML initiatives.

• Design, develop, and optimize data engineering solutions on Databricks
• Build high-performance Apache Spark jobs using PySpark and Spark SQL
• Develop and manage Databricks notebooks, jobs, and workflows
• Optimize Spark performance, cluster configuration, and cost efficiency
• Build and maintain robust ETL/ELT pipelines using Python, Spark, and Databricks
• Process large-scale structured and semi-structured datasets
• Ensure data quality, reliability, and scalability of pipelines
• Implement reusable and modular pipeline frameworks

• Create analytics-ready datasets using strong SQL modeling
• Support BI and reporting platforms by delivering accurate and timely data
• Collaborate with analytics teams to understand business requirements
• Improve query performance for dashboards and reports

• Prepare and curate data for AI/ML workloads on Databricks
• Support feature engineering, model training, and batch/real-time scoring pipelines
• Work closely with Data Scientists to operationalize AI solutions
• Enable end-to-end data workflows for AI-driven use cases
• Partner with Data Science, Analytics, and Platform teams
• Ensure adherence to data governance, security, and compliance standards
• Document pipelines, data models, and operational processes
• Participate in code reviews and best practice definition

• Strong experience in SQL (complex queries, performance tuning)
• Proficiency in Python for data engineering and analytics
• Hands-on experience with Apache Spark (PySpark / Spark SQL)
• Proven experience as a Databricks Developer
• Experience supporting analytics and reporting use cases
• Exposure to AI/ML data workloads and large-scale analytics platforms

• Strong analytical and problem-solving abilities
• Experience handling large and complex datasets
• Ability to translate business requirements into technical solutions
• Good communication and stakeholder engagement skills

• Experience with Databricks Delta Lake, Unity Catalog, or MLflow
• BFSI / enterprise analytics experience
• Familiarity with cloud platforms (Azure, AWS, or GCP)
• Knowledge of data quality checks and monitoring frameworks