Databricks Engineer

Overview

The corporate IT Services team with Express Employment International is seeking a highly skilled Databricks Engineer with advanced expertise in Databricks CI/CD pipelines and streaming table development. The ideal candidate will have hands-on experience implementing robust CI/CD processes within the Databricks environment, enabling efficient code deployment, automated testing, and streamlined release management.

• Develop, maintain, and optimize Databricks CI/CD pipelines for automated deployment and testing
• Evaluate, understand and assist in planning for compute and job cluster resources in Azure Databricks environments
• Design and implement streaming tables with support for schema evolution and optimization
• Collaborate with data architects and business stakeholders to understand data requirements and deliver scalable solutions
• Troubleshoot and resolve issues related to table schemas, data ingestion, and streaming performance
• Ensure data quality, security, and compliance throughout the engineering process
• Databricks environmental change tracking

• Bachelor’s degree in Computer Science, Engineering, or equivalent experience in related field
• 5+ years of experience in data engineering, with a focus on cloud data solutions

• Proficiency in Azure cloud computing and data architecture design
• Implementation of a data lake solution using Azure Databricks, integrating various data sources, and enabling analytics for business intelligence
• Proven experience with Databricks, including CI/CD pipeline management and streaming table development
• Expertise in schema evolution and optimization within streaming data architectures
• Strong programming skills in Python and SQL
• Familiarity with YAML a plus
• Proficient with GIT
• Excellent problem-solving and communication abilities

Not sure you meet every requirement? Apply anyway!

Express Employment International supports Express Employment Professionals franchises and related brands. The Express franchise brand is an industry-leading, international staffing company with more than 870 franchise locations in the U.S., Canada, South Africa, Australia, and New Zealand. Headquartered in Oklahoma City, our corporate team is committed to empowering franchisees by providing world-class support, training, and strategic guidance through a unified global network.

Our mission is to professionally market and provide quality human resource solutions through an international franchising network—benefiting our associates, clients, franchisees, corporate staff, shareholders, and the communities we serve. Our vision is simple yet powerful:
To help as many people as possible find good jobs by helping as many clients as possible find good people.