Databricks Data Engineer

Overview

Location: Salt Lake City, UT

Salary: $50.00 USD Hourly – $52.00 USD Hourly

Description:
About the role: Our client is currently Seeking a hands-on Databricks Data Engineer to migrate and modernize on-prem data lake workloads to Databricks on Google Cloud Platform, building scalable Spark-based data pipelines. The role requires strong PySpark, Python, SQL, and CI/CD experience, with close collaboration across product, business, and Agile teams.

• Define and implement migration patterns for the Data Lake Modernization initiative.
• Migrate use cases from on-premises Data Lake to Databricks on Google Cloud Platform.
• Collaborate with product managers and business stakeholders to gather requirements and reporting needs.
• Follow best practices for development lifecycle, including testing, code reviews, CI/CD, and documentation.
• Create and maintain feature design documents and workflows.
• Participate in team discussions and product development meetings.
• Stay current with industry trends and emerging design patterns.

• Bachelor’s degree in Computer Science, Computer Engineering, or related field.
• 4-6 years of development experience with Spark (PySpark), Python, and SQL.
• Strong expertise in building data pipelines and hands-on Databricks development.
• Experience working on Linux OS.
• Knowledge of scheduling/orchestration tools (e.g., Databricks Workflows, Airflow, Prefect, Control-M).
• Solid understanding of distributed systems, data structures, and design principles.
• Strong communication skills for demos and showcases.
• Familiarity with Agile methodologies (SAFe, Kanban, Scrum).

• 3 years of experience with Git and CI/CD pipelines (e.g., Azure Pipelines).
• Exposure to streaming technologies (Kafka, Spark Streaming).
• Experience with Docker and Kubernetes for application deployment.
• Cloud experience with Azure or Google Cloud Platform.

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively “Judge”) to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge’s Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes.

Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

This job and many more are available through The Judge Group. Please apply with us today!