Sr. Databricks Engineer

To Apply for this Job

Job Title: Sr. Databricks Engineer
Job Type: Contract to Hire
Location: Remote EST or CST timezone
Work Authorization: US Citizen or Green Card Holder, will not sponsor

The Senior Databricks Engineer is within the Information Technology Department and serves as a technical leader responsible for designing, building, and evolving the Databricks-based analytics and data platform. This role plays a critical part in advancing the company’s modern data architecture, enabling scalable analytics, reliable data products, and advanced use cases across the organization. Working closely with data science, analytics, IT, and business stakeholders, the Senior Databricks Engineer translates business and analytical requirements into robust, production-grade data pipelines and platform capabilities.

This role helps mature the company’s Databricks environment by establishing best practices, improving performance and reliability, and ensuring the platform is secure, governed, and positioned to support future growth and advanced analytics initiatives.

• Serve as a senior technical contributor and platform leader for Databricks environment, supporting ongoing implementation, optimization, and continuous improvement.
• Design, build, and maintain scalable data pipelines using Databricks, supporting Bronze, Silver, and Gold layer architectures.
• Develop and optimize data transformations using Python and SQL to support analytics, reporting, and data science use cases.
• Partner with data science and analytics teams to enable advanced analytics, machine learning workflows, and self-service analytics capabilities.
• Implement and maintain data governance standards using Unity Catalog, including access controls, data lineage, and environment management.
• Monitor platform performance, troubleshoot complex issues, and optimize jobs for reliability, scalability, and cost efficiency.
• Design and support data ingestion processes from enterprise systems such as Dynamics, HRIS, finance, and other operational platforms.
• Establish and promote engineering best practices including code standards, testing, documentation, and deployment processes.
• Support the enablement of business users and analysts through curated data products, semantic layers, and tooling such as Databricks SQL and Genie.
• Collaborate with IT and security teams to ensure platform security, compliance, and operational stability.
• Serve as an escalation point for complex data platform issues, ensuring root-cause analysis and long-term remediation.
• Continuously evaluate new Databricks features and capabilities and recommend adoption where beneficial.

• 5+ years of experience in data engineering, analytics engineering, or platform engineering roles.
• Strong hands-on experience with Databricks in a production enterprise environment.
• Advanced proficiency in Python and SQL for data transformation and pipeline development.
• Experience designing and implementing modern data architectures, including layered (Bronze/Silver/Gold) data models.
• Experience working with cloud-based data platforms and distributed data processing concepts.
• Solid understanding of data governance, security, and access control concepts.
• Experience monitoring, troubleshooting, and optimizing data pipelines and jobs.
• Ability to translate business and analytical requirements into scalable technical solutions.
• Strong problem-solving skills with the ability to diagnose and resolve complex data issues.
• Excellent communication skills and ability to partner effectively with technical and non-technical stakeholders.
• Excellent client management skills and the ability to work with customers to develop and manage an action plan.
• Demonstrated excellence in communicating and presenting complex information to technical and non-technical stakeholders, both verbally and in written form.
• Self-starter and able to work independently with minimal supervision.
• Accounts for possible project challenges on constraints including risks, time, resources, and scope.
• Works closely with project management teams to successfully monitor progress of initiatives.

• Experience with Unity Catalog, data…