Sr. Data Engineer – Active Secret; S clearance and be able to obtain TS​/SCI cle

Sr. Data Engineer – Must have an Active Secret (S) clearance and be able to obtain a TS/SCI clearance and DHS Suitability

We are seeking to hire a Sr. Data Engineer for an on-site role in Dulles, VA. Must have an Active Secret (S) clearance, be able to obtain a TS/SCI clearance, and DHS Suitability. Epic Systems is supporting a U.S. Government customer on a large mission‑critical development and sustainment program to design, integrate, build, deliver, and operate a network operations environment, introducing new cyber capabilities to address emerging threats.

This position is a Databricks Engineer supporting the migration of customer applications, services, and platforms to a Medallion Model.

• Design, develop and implement end‑to‑end data ingestion and processing pipelines using various cloud and platform technologies.
• Transform incoming bronze (RAW) data into silver (clean) and then into gold tier projections (Medallion model).
• Schedule, orchestrate and monitor automated/semi‑automated data pipelines.
• Perform mapping and integration of data assets in support of multiple mission customers.
• Develop and maintain data engineering team process improvement plans.
• Develop code using programming and scripting languages to automate data ingestion, pipeline orchestration and improve data management processes.
• Ingest transparency, leveraging technologies such as AWS Cloud Watch to identify places for measuring and gathering performance information on automated data pipelines.
• Ensure data engineering team standard operating procedures are appropriately captured and communicated across the team.
• Ensure technical correctness, timeliness and quality of delivery for the team.
• Demonstrate excellent oral and written communication skills to all levels of management and the customer.

• Active Secret (S) clearance; must be able to obtain TS/SCI clearance.
• Must be able to obtain DHS Suitability.
• 8+ years of software engineering experience.
• Minimum of 4 years of experience performing data engineering work in a cloud environment.
• Experience with relational, No
  
  SQL and/or file‑based storage (e.g., Databricks, Elastic, Postgre
  
  SQL, etc.).
• Experience with Dev Ops tools such as Jenkins, Docker, Ansible, Puppet, Chef, Splunk, etc.
• Working knowledge of Databricks, cloud relational database services and Elasticsearch.

• Experience with Databricks workflows, Unity Catalog, Autoloader, Delta Live Tables and Apache Spark.
• Basic working knowledge with Apache NiFi.
• Experience with collaboration tools including MS Teams, MS Outlook, MS SharePoint and Confluence.
• AWS Professional certification or equivalent.

• DoD 8570.1‑M Compliance at IAT Level I (e.g., CISSP) highly desired.

• Bachelor’s degree in Software Engineering, Computer Science or a related discipline is required. Ten (10) years of experience (for a total of eighteen (18) or more years) may be substituted for a degree.