Databricks Engineer

Overview

Our client is implementing Databricks from the ground up and seeking mid‑to senior‑level engineers who can guide best practices, platform adoption, and governance. This is a greenfield environment, ideal for consultants who want to shape architecture and standards from day one. You will collaborate with Palantir teams and help establish a modern data ecosystem that includes Unity Catalog and emerging AI capabilities.

Job # 3017540

Our client is implementing Databricks from the ground up and seeking mid‑to senior‑level engineers who can guide best practices, platform adoption, and governance. This is a greenfield environment, ideal for consultants who want to shape architecture and standards from day one. You will collaborate with Palantir teams and help establish a modern data ecosystem that includes Unity Catalog and emerging AI capabilities.

• Lead Databricks platform build‑out. Define and implement foundational structures for catalogs, schemas, and data assets; set up permissions and governance in Unity Catalog.
• Establish best practices. Advise on ingestion, modeling, and orchestration patterns for practical applications in a new Databricks environment.
• Enable AI features. Explore and prototype Databricks AI capabilities (Mosaic AI, AI/BI Genie, DBRX, foundation models) to inform future adoption.
• Collaborate cross‑platform. Work with Palantir engineers and Snowflake teams to ensure seamless integration and governance alignment.
• Document and coach. Create playbooks, standards, and knowledge artifacts to accelerate internal adoption.

• Databricks expertise:
  Hands‑on experience with Databricks platform components (Work spaces, Clusters, Jobs, SQL Warehouses) and Unity Catalog governance.
• Data Engineering:
  Strong SQL/PySpark skills; experience designing ingestion and transformation pipelines; familiarity with CI/CD and orchestration tools.
• Governance:
  Practical knowledge of catalog structures, asset registration, and permission models; prior involvement in a Unity Catalog implementation is highly preferred.
• Adaptability:
  Comfort working in a greenfield environment with evolving requirements; ability to set direction amid uncertainty.
• Bachelor’s degree in Data Science, Statistics, Mathematics, Business Analytics, or a related field, or equivalent professional experience.

• Databricks certifications (Lakehouse Fundamentals, Data Engineer Associate/Professional) are a strong plus; willingness to obtain certification post‑hire is expected.

Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA, the Support Linc Employee Assistance Program with up to 8 free counseling sessions, a corporate discount savings program and other discounts.

In addition, professional development opportunities include an on‑demand training program, access to certification prep, and a library of technical and leadership courses once you have 6+ months of tenure.

Apex is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law.

Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Benefits Department at [email protected] or 804‑523‑8228.

(Do not submit resumes or solicit consultants to this email address). United Healthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Apex Systems.