Lead Business Analyst - Databricks

We value all of our employees who make our growth and success possible. We are proud to offer industry leading compensation, comprehensive benefits,401(k) match with additional profit sharing,PTO and abundant career opportunities.

Come join our award winning 12,000 strong organization as we fuel the world and each other!

We are looking for a highly technical Databricks Lead with strong hands-on experience in designing and delivering enterprise data solutions

• Solution architecture and design documents.
• Working Databricks notebooks, jobs, workflows, and reusable code assets.
• Data pipeline standards and reference patterns.
• Performance, scalability, and cost optimization recommendations.
• Technical design review inputs and architecture decisions.
• Issue resolution plans for production and performance problems.
• Clear stakeholder communication on design and delivery progress.

• Databricks solutions are delivered on time and meet business needs.
• Pipelines are reliable, scalable, and supportable.
• Data quality and operational controls are in place.
• Production issues are resolved quickly with minimal disruption.
• Architecture decisions are documented and reusable.
• Team capability improves through leadership and mentoring.

To perform this job successfully, an individual must be able to perform each essential job duty satisfactorily. The requirements for this position are listed below:

• Bachelor's degree or equivalent and 8+ years of relevant work experience
• Strong hands-on experience with Databricks in enterprise environments.
• Experience leading multiple end-to-end Databricks implementations.
• Proven expertise in medallion architecture, including Bronze, Silver, and Gold layers.
• Strong working knowledge of Spark, Delta Lake, SQL, Python, and data pipeline design.
• Experience with data ingestion, transformation, orchestration, and data quality controls.
• Ability to troubleshoot complex production issues and optimize performance.
• Experience translating business and functional needs into technical solutions.
• Strong understanding of architecture standards, reusable frameworks, and best practices.
• Experience collaborating with business stakeholders, architects, and engineering teams.
• Exposure to deployment planning, code reviews, release management, and production support.
• Ability to lead technical discussions and mentor team members.

• Experience with Azure, AWS, or GCP.
• Familiarity with Unity Catalog, Delta Sharing, and governance practices.
• Experience with CI/CD, automated testing, and release pipelines.
• Background in data modernization or migration programs.
• Exposure to analytics, data warehousing, or machine learning use cases

The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job.

• Usually, normal office working conditions.
• Must be able to remain in a stationary position 50% of the time due to prolonged periods of sitting or standing.
• Occasional overnight travel may be required.

Energy Transfer is an equal opportunity employer and does not discriminate against qualified applicants on the basis of actual or perceived race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, pregnancy, veteran status, genetic information, citizenship status, or any other basis prohibited by law.

The nature and frequency of the above working conditions and requirements may vary depending on individual operational circumstances. Where feasible, the Partnership will make reasonable accommodations to qualified individuals with disabilities to enable them to perform the essential functions of the job.

The statements listed in this job posting, which are subject to change, are intended to describe the general nature and level of work being performed by people assigned to this job. They are not intended to be an exhaustive list of all responsibilities, duties and skills required of personnel so classified.