Senior Databricks Architect Specializing in Cloud Data Solutions

Take the stage as a Senior Databricks Architect and drive the optimization of ETL pipelines on cloud platforms. Your strong experience in Databricks, Spark, SQL, and real-time data processing will be essential.

This role is designed for leaders in data engineering who excel in building efficient ETL pipelines. Utilize your skills with Python and PySpark while integrating APIs and supporting real-time streaming solutions. Collaborate with cross-functional teams to manage projects and improve data workflows using Azure Dev Ops and Airflow.

Key Responsibilities:

• Build and manage ETL pipelines with Databricks

• Develop data processing strategies using SQL and Python

• Implement CI/CD processes via Azure Dev Ops

• Utilize Airflow for effective workflow management

• Support real-time data integration and streaming solutions

Requirements:

• Extensive experience with Databricks and Spark

• Strong capabilities in SQL and Python for ETL development

• Experience with AWS or Azure platforms is essential

• Familiarity with Delta Lake for data processing needed

• Proven track record in leading data engineering initiatives

Drive innovation in data processing and engineering with your deep expertise in cloud technologies.
#J-18808-Ljbffr