Lead Data Engineer; DataOps Azure, Databricks, CI/CD
Listed on 2026-09-04
-
IT/Tech
Data Engineering, Cloud Computing: Infrastructure & Operations, SRE/Site Reliability
Location: New York
Location:
Short Hills, NJ / Hartford CT / Charlotte, NC (Hybrid working - 3 days a week) Perm/FTE Role US citizens and Green Card Holders and those authorized to work in the US are encouraged to apply. We are unable to sponsor H1b candidates at this time Job summary
- This is a brand-new Data Ops leadership role created to help build and formalize Data Ops function from the ground up. With major investments in cloud data, analytics, and AI
, the company needs someone who can bring greater structure, consistency, automation, and operational discipline to its growing data environment. - You’ll be a hands-on technical leader working across Data Engineering, Dev Ops, Enterprise Architecture, Information Management, Security, Infrastructure, and BI teams. The focus is not simply managing people, but building the Data Ops practice, establishing CI/CD and engineering standards, improving pipelines, and helping teams operationalize data solutions effectively
. - The environment is centered around Azure and Databricks
, with technologies including SQL, Terraform, Azure Dev Ops, ETL tools, and on-prem/cloud data platforms
. - This role is ideal for a self-starter who can wear multiple hats
: part Data Ops leader, part architect, part hands-on practitioner, and part change agent. Strong communication and collaboration skills are equally important as technical depth. - In short: you’ll have the opportunity to build the Data Ops function from the ground up and shape how data engineering is delivered and operated across the organization.
- Build and evolve the Data Ops operating model, standards, and best practices.
- Lead CI/CD, automation, orchestration, monitoring, and data quality initiatives.
- Partner with Data Engineering, Architecture, Analytics, AI/ML, Dev Ops, Security, and Infrastructure teams.
- Improve reliability, scalability, performance, and operational consistency of data platforms.
- Drive cloud cost optimization and operational excellence.
Provide technical leadership, mentor engineers, and help shape the future Data Ops organization.
- 8+ years in data engineering, analytics engineering, or platform engineering.
- 3+ years in a lead/senior engineering or data platform role.
- Strong experience with Azure and Databricks/Lakehouse environments.
- Hands-on experience with SQL, Python/PySpark, data pipelines, and orchestration
. - Strong understanding of CI/CD and Azure Dev Ops
. - Experience with tools such as ADF, Airflow, Dagster, dbt, Terraform, Git Hub Actions, or Git Lab
. - Strong communication, collaboration, and technical leadership skills.
- Experience in insurance, financial services, healthcare, or other regulated environments is a plus.
A reasonable, good faith estimate of the minimum and maximum base salary for this position is $140k to $160K . This position will also include a discretionary bonus or 10% that generally will be depending on a variety of factors. Employee benefits will also be available, and details are available like Pension/401K/ Paid Vacation/ Life, Medical & Dental insurance etc.
* The pay range listed above reflects the expected starting salary /Pay rate for this role. This range may be adjusted based on market conditions, location, and other relevant factors. The Company will determine the final starting salary/Pay rate in consultation with the selected candidate(s), in full compliance with applicable laws
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).