Data Engineer

Overview

We're hiring a Databricks Developer to build and own our cloud-based data platform from the inside out. This is a newly created, high-impact position reporting to the Director of Enterprise Applications and Data Analytics within Information Technology.

• Design, develop, and maintain scalable data pipelines and ELT/ETL workflows using Databricks and Apache Spark (PySpark/Spark SQL).
• Build and optimize lakehouse architecture using Delta Lake and related formats (Parquet, Iceberg).
• Apply medallion architecture principles — bronze, silver, and gold layers — across solution designs.
• Develop production-grade data workflows using Databricks Workflows and/or Declarative Pipelines.
• Implement data governance, security, and access controls using Unity Catalog.
• Support migration from legacy data warehouse systems to modern, cloud-based architectures.
• Design and implement solutions on AWS, Azure, or GCP.
• Implement CI/CD pipelines and infrastructure-as-code (Terraform, Databricks Asset Bundles, Git Hub Actions).
• Monitor, troubleshoot, and resolve production pipeline issues to ensure reliability and performance.
• Partner with technical and business stakeholders to translate requirements into scalable data solutions.
• Facilitate technical workshops to identify opportunities and deliver business value.
• Participate in code reviews, testing, documentation, and deployment activities.
• Contribute to the continuous improvement of data engineering standards, tools, and best practices.
• Provide technical support during implementation and stabilization phases.

• Required 5+ years of data engineering experience.
• 4+ years of hands-on experience with the Databricks platform.
• Strong proficiency in Apache Spark (PySpark and/or Spark SQL).
• Experience designing and implementing solutions on AWS, Azure, or GCP.
• Hands-on expertise in ELT processes, data security, data wrangling, and cloud computing.
• Proficiency in SQL, data integration/EAI, database technologies, and visualization platforms.
• Cross-functional experience — you’ve worked across multiple environments, not siloed in one space.
• Highly analytical, detail-oriented, and self-motivated with strong written and verbal communication skills.
• Bachelor's degree in Engineering, IT, Computer Science, or a related field (preferred).

• Databricks certification (especially valuable if no degree).
• Experience with business analytics design and development.
• Familiarity with business processes and company-wide systems.
• Background in manufacturing or similarly complex operational environments.
• Strong change enablement and business process redesign experience.