CyberSecurity Data Engineering Lead
Listed on 2026-11-06
-
Software Development
Data Engineering
Cyber Security Data Engineering Lead
LocationRemote
Job DescriptionOur client, Cyber Security is seeking a Cyber Security Data Engineering Lead to join their team. As a Cyber Security Data Engineering Lead, you will be part of the Compliance & Security Data Engineering team supporting the Compliance Data Platform initiative. The ideal candidate will have a strong drive to build reliable data pipelines, a collaborative mindset to translate security and compliance needs into measurable logic, and the ability to deliver production-ready engineering through disciplined SDLC practices.
Responsibilities- Build & operate the compliance data foundation as a principal individual contributor, advancing newly acquired compliance and security datasets into high-utility data products that measure and monitor control performance and effectiveness.
- Implement and maintain end-to-end Databricks ETL pipelines, transforming raw data into structured, standardized compliance datasets that are ready for consumption and analysis.
- Design, optimize, and run Medallion data pipelines (Bronze, Silver, and Gold) to ensure raw, conformed, and consumption-ready compliance data layers are consistent, reliable, and scalable.
- Normalize core security and compliance data by developing data normalization schemas for high-volume telemetry feeds ingested from tools such as Service Now, Microsoft Defender, Crowd Strike, Zscaler, Wiz, Microsoft Entra , SailPoint, and others.
- Transform telemetry into monitored logic by partnering with data source and control domain owners to translate datasets into monitoring enablement and programmatic control-testing logic embedded directly in the data layer.
- Bachelor’s degree with 5–8 years of experience across a hybrid of Cyber Security Operations (e.g., threat detection engineering, security telemetry analysis) and Security Compliance/GRC roles.
- Advanced Databricks engineering expertise, including building ETL pipelines, orchestrating data workflows, and developing analytics in Databricks; experience developing, deploying, or managing custom Databricks applications or Databricks Agents is a strong plus.
- Proven capability to normalize, correlate, and test data structures sourced from security, identity, and governance platforms (Service Now, Defender, Crowd Strike, Zscaler, Wiz, Entra , SailPoint).
- Solid understanding of security compliance frameworks and policy-to-control translation logic, with experience deploying continuous control monitoring (CCM) strategies within a secure cloud data lake.
- Hands-on Agile SDLC experience, including Git/Git Hub version control, peer review cycles, and release testing/approval gates; strong communication skills to bridge complex engineering requirements with business-facing risk management objectives.
Own the engineering of compliance data products that directly support control performance measurement and monitoring. Build robust Databricks ETL pipelines and Medallion-layer architectures that turn raw telemetry into structured, standardized datasets. Collaborate with security and control domain owners to embed monitoring and control-testing logic directly into the data layer. Develop high-insight compliance dashboards, reports, and analytic applications that reveal coverage gaps and operational effectiveness.
Strengthen your SDLC and release discipline through Git Hub-based workflows, automated job monitoring, exception handling, and reliable promotion into production.
- Medical and Prescription Drug Plans
- Dental Plan
- Vision Plan
- Health Savings Account
- Health Flexible Spending Account
- Dependent Care Flexible Spending Account
- Supplemental Life Insurance
- Short Term and Long Term Disability Insurance
- Business Travel Insurance
- 401(k), Plus Match
- Weekly Pay
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).