Data Engineer Software Developer
Listed on 2026-06-25
-
IT/Tech
Data Engineering
The Leidos Digital Modernization Group seeks a Data
Engineer Software Developer for the Global Solution Management - Operations II (GSM-O II) contract, under the Global Automations & Intelligent Network Solutions (GAINS) Team. Seeking a Back‑End Developer to join the Real‑Time Visibility (RTV) team, focused on designing, building, and maintaining the infrastructure and systems that collect, store, process, and analyze large volumes of network operations data for the DISN network.
This role is critical for ensuring that data from disparate sources - such as logs, performance metrics, events, ticketing, ordering, and CMDB systems - is readily available, reliable, and performant for business and mission use. The existing platform is built on Elastic stack and Confluent Kafka platforms. The ideal candidate will have a strong background in data engineering, platform operations, and integration, with experience in large‑scale, mission‑critical environments.
Responsibilities
- Designs, builds, and maintains scalable, reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting.
- Unifies and integrates data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements.
- Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat Open Shift (Kubernetes), including creating Kafka, Elastic, and Logstash pipelines and supporting Kibana visualizations and dashboards with React, JavaScript, and HTML.
- Develops and manages data warehouses and data lakes to support analytics, reporting, and operational dashboards, optimizing infrastructure for performance, scalability, and cost‑effectiveness through automation and best practices.
- Continually analyze and optimize ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms.
- Automates data‑related tasks such as ETL/ELT processes, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.
- Collaborates with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions, and documents data architecture, integration patterns, and operational procedures.
- Troubleshoots and resolves issues related to data ingestion, processing, and platform performance, storage, memory, partitioning, and cluster performance.
- Bachelor’s degree in Computer Science, Engineering, or related technical discipline and 4+ years of relevant experience.
- Hands‑on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources.
- Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).
- Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting.
- Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
- Familiarity with network operations data (logs, metrics, events, ticketing, CMDB) and related data models.
- Experience with Linux/UNIX system administration and automation.
- Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs).
- Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and Dev Ops practices.
- Strong communication and documentation skills for collaboration and knowledge sharing.
- Must be able to commute to Scott AFB, IL for up to full‑time onsite support.
- Ability to obtain interim Secret DoD Security clearance before the start date.
- Ability to obtain Security+ certification or equivalent DoD 8570 IAT II certification within 14 days of the start date.
- Experience with DISA, DISN, or other DoD network environments, including developing and deploying software applications that meet DoD security standards (e.g., STIGs), and knowledge of network security, encryption, and access controls in classified environments.
- Experience…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).