Databricks Expert

Databricks Expert role at Sprezzatura

Location:

Virtual
Other Consideration:
Authorized to work in the United States and ability to obtain Public‑Trust Clearance

The Databricks expert builds scalable data pipelines, optimizing workloads, and enabling advanced analytics across cloud platforms. The role collaborates with data scientists and engineers to transform raw data into actionable insights, ensuring high performance, data integrity, and seamless integration within the Databricks environment. The Databricks expert builds robust data lakehouse architectures and enables advanced analytics and machine learning workflows. This role involves collaborating with various stakeholders to understand data requirements and develop solutions.

• Develop and maintain ETL/ELT pipelines using Databricks notebooks and workflows.
• Optimize Spark jobs for performance, scalability, and cost‑efficiency.
• Design and implement data lakehouse architectures.
• Integrate Databricks with external data sources, APIs, and on‑prem databases.
• Collaborate with data scientists, analysts, and engineers to support end‑to‑end solutions.
• Ensure data governance, security, and compliance using tools like Unity Catalog and RBAC.
• Mentor junior developer and contribute to engineering best practices.

• Strong analytical and problem‑solving skills.
• Proficiency in SQL, Python, R, or other data analysis languages.
• Experience with data visualization tools and reporting platforms.
• Strong understanding of statistics, data modeling, and analytical techniques.
• Similarity with databases, data warehouses, and ETL processes.
• Ability to lead and motivate a remote team.
• Excellent time management and organizational skills.
• Adaptability and openness to new ideas.

• Bachelor’s degree in computer science, Information Technology, or a related field. (Master's degree preferred).
• 5+ years of experience as a data analyst.
• Proficiency and experience in SQL, database management systems such as Oracle, SQL Server, MySQL.
• Strong knowledge of database structures, theories, principles and practices.
• 5+ years of experience in big data engineering or analytics.
• Experience with cloud platforms, ML, and data cataloguing tools.
• Understanding of data privacy and protection regulations.

Transitioning military and/or Veterans with IT/IS, finance, and/or healthcare systems specialties are invited to apply.

Seniority level:
Mid‑Senior level

Employment type:

Full‑time

Job function:
Other

Industries:
Business Consulting and Services

Sprezzatura expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of Sprezzatura’s employees to perform their job duties may result in discipline up to and including discharge.

This position may require Public Trust clearance. Candidates must undergo a background investigation, including a review of employment history, education, criminal record, and financial history. The clearance process ensures that the candidate is reliable, trustworthy, and of good conduct and character. Employment offers are contingent upon successful passing a public trust clearance process.

Sprezzatura () is a Washington, DC‑area Service‑Disabled Veteran‑Owned Small Business (SDVOSB) that enables client success by supplying insight and leadership at the intersection of people, processes, and technology.

Work Authorization

This role requires you to live within the United States. Evidence of work authorization upon employment is required in compliance with the Immigration Reform and Control Act of 1986. Completion of USCIS form I‑9 will be required to verify employment eligibility within 3 business days of the first day of employment.