Azure Databricks Engineer
Listed on 2026-06-27
-
IT/Tech
Data Engineering, Azure, Cloud Computing: Infrastructure & Operations
Azure Databricks Engineer
Collaborate with source data application teams and product owners to design, implement, and support analytics solutions that provide actionable insights.
Implement data migration and data engineering solutions using Azure products and services:
Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc., along with traditional data warehouse tools.
Perform multiple aspects of the development lifecycle: design, cloud engineering (infrastructure, network, security, administration), ingestion, preparation, data modeling, testing, CI/CD pipelines, performance tuning, deployments, consumption, BI, alerting, and production support.
Provide technical leadership and collaborate within a team environment or work independently.
Participate in a Dev Ops team that owns and supports their product.
Implement batch and streaming data pipelines using cloud technologies.
Bring senior-level expertise in Databricks, Azure services, and leading teams.
Formulate solutions, recognize problems, and work with geographically dispersed teams.
Work effectively in Agile environments and be available for CST time zone shifts.
Strong written and oral communication skills.
Responsibilities- Design, implement, and support analytics solutions with source data teams.
- Implement data migration and engineering solutions using Azure and traditional tools.
- Manage all development lifecycle stages, including cloud infrastructure, data modeling, testing, CI/CD, BI reporting, and production support.
- Lead and mentor team members while providing technical guidance.
- Deliver batch and streaming data pipelines using Azure cloud technologies.
- Ensure solution quality, security, and performance across all data processes.
- Bachelor’s degree in Computer Science, Engineering, or related technical discipline, or equivalent experience.
- 3+ years in software solution development using Agile/Dev Ops.
- 3+ years of data analytics experience using SQL.
- 2+ years of Azure cloud development and data lake experience, including Azure Data Factory, Databricks, Event Hub, Blob Storage, Data Lake, Functions, Dev Ops, Power Apps, and Power BI.
- Development, administration, and support experience in Python, PySpark, Unix, SQL, Teradata, SQL Server, ADLS, Azure Data Explorer.
- CI/CD tools:
Git Hub, Azure Dev Ops, Terraform. - BI tools:
Power BI, Cognos. - Top skills:
Agile development, Databricks/Python, Azure Data Factory, data validations.
Preferred Qualifications
- 5+ years of software solution development in Agile/Dev Ops.
- 3+ years of full-stack development experience in Azure.
- 3+ years of cloud/data lake experience with Azure services (Event Hub, Data Factory, Databricks, Dev Ops, Blob Storage, Power Apps, Power BI).
- Airline industry experience is a plus.
- Azure Development Track and Spark Certifications preferred.
- Expertise in Azure stack for data ingestion, processing, curation, and consumption layers.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).