Lead Enterprise Data Engineer

Overview

Join to apply for the Lead Data Platform Engineer role at Commence
.

At Commence, we’re the start of a new age of data-centric transformation, elevating health outcomes and powering better, more efficient processes to program and patient health. We combine quality data-driven solutions that fuel answers, technology that advances performance, and clinical expertise that builds trust to create a more efficient path to quality care. With human-centered, healthcare-relevant, and value-based solutions, we create new possibilities with data and provide proof beyond the concept and performance beyond the scope with a focus on efficiencies that transform the lives of those we serve.

Responsibilities, qualifications, and related details are described below.

• Administer and manage Databricks work spaces, clusters, and security configuration.
• Design and implement scalable ingestion pipelines (batch and streaming) into Delta Lake.
• Establish CI/CD practices for data pipelines and implement cost monitoring/optimization.
• Ensure alignment with FedRAMP, HIPAA, and FISMA security and compliance requirements.
• Partner with Dev Ops to implement infrastructure-as-code and automation practices.
• Collaborate with stakeholders (engineering, backend, Dev Ops, product) to identify platform gaps and design scalable, long-term solutions that unlock product innovation.
• Provide technical leadership and management of data engineers, fostering technical growth, improving team practices, and elevating the quality of engineering across the board.
• Collaborate with Analytics and Data Science leads to deliver trusted, reusable data assets.
• Ensure operational excellence by automating infrastructure, monitoring key systems, and leading incident response and root cause analysis for platform-related issues.
• Evaluate and introduce new technologies and practices (e.g., container orchestration, data lake solutions, workflow orchestration tools) based on evolving business needs.
• Define and enforce platform best practices for coding standards, testing, monitoring, and documentation.
• Perform other duties as assigned.

• 7+ years of experience in data engineering, platform architecture, or related roles.
• Hands-on expertise with using and administering Databricks, Spark, Delta Lake, and orchestration tools (Airflow, Databricks Workflows, etc.).
• Demonstrated experience in implementing Data Lakes/Lakehouse architecture using Databricks and AWS technologies.
• Familiarity with modern data frameworks like Data Fabric/Mesh is a plus.
• Strong knowledge of AWS services (incl. Gov Cloud), IAM, VPC, and network security.
• Experience with Unity Catalog or equivalent governance/cataloging tools.
• Familiarity with regulated environments (HIPAA, FedRAMP, FISMA).
• Demonstrated ability to design secure, cost-effective, and scalable data platforms.
• Strong problem-solving skills, attention to detail, and a passion for continuous learning.
• Experience working in a healthcare or regulated environment.

Commence.

AI is committed to providing equal employment opportunities to all applicants, including individuals with disabilities. If you require a reasonable accommodation to participate in the application process due to a disability, please contact Human Resources at  or hr.

Please note that unless you are requesting an accommodation, all applications must be submitted through our online application system.

• Mid-Senior level

• Full-time

• Engineering and Information Technology
• Industries:
  Technology, Information and Internet

Referrals increase your chances of interviewing at Commence by 2x. Apply BELOW