Data Engineering Software Developer Sr

Career Opportunities with Amatriot Group, LLC

A great place to work.

Share with friends or Subscribe!

Are you ready for new challenges and new opportunities?

Join our team!

Current job opportunities are posted here as they become available.

Subscribe to our RSS feeds to receive instant updates as new positions become available.

Location: Washington, DC 100% Onsite
Clearance: Top Secret/SCI
Job Type: Full-time
Target Salary Range*:$175,000 - $200,000

* This represents the potential salary range for this position depending on education level, years of experience and/or certifications in addition to other position specific requirements which may impact salary

The Senior Data Engineer designs, builds, integrates, and sustains scalable data systems and pipelines that support analytics, reporting, and operational insight across complex enterprise environments. This role focuses on ingesting, processing, transforming, and unifying large and disparate data sources while ensuring data quality, security, performance, and compliance with DoD and DISA requirements.

The Senior Data Engineer works with Confluent Kafka, Elastic Stack, AWS, Red Hat Open Shift/Kubernetes, data warehouses, and data lakes to deliver reliable and efficient data solutions. The role also supports automation, CI/CD, platform optimization, visualization capabilities, and collaboration across data, software, and network operations teams.

• Design, build, and maintain scalable and reliable data systems and pipelines for ingesting, processing, and transforming large, complex, and disparate data sources.
• Unify and integrate data from multiple network operations systems into a consistent and accessible platform.
• Create and maintain Kafka, Elastic, and Logstash pipelines to support enterprise data ingestion and processing.
• Automate ETL/ELT processes, data validation, cleansing, monitoring, and related data-engineering activities.

• Implement data solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat Open Shift/Kubernetes.
• Develop and manage data warehouses and data lakes supporting analytics, reporting, and operational dashboards.
• Optimize data infrastructure for scalability, reliability, performance, and cost effectiveness.
• Apply automation and engineering best practices to improve platform maintainability and operational efficiency.

• Analyze and optimize ingestion throughput, query performance, indexing strategies, storage efficiency, and cluster utilization across Elastic and Kafka platforms.
• Troubleshoot and resolve issues related to data ingestion, processing, storage, memory, partitioning, and cluster performance.
• Identify and resolve platform bottlenecks affecting data availability and downstream analytics.

• Support Kibana visualizations and dashboards.
• Collaborate with data analysts, visualization engineers, and other stakeholders to deliver integrated and actionable data solutions.

• Ensure data quality, accuracy, security, and compliance with applicable DoD and DISA requirements.
• Support CI/CD pipelines for automated build, test, and deployment activities.
• Apply version control and Dev Ops practices to data-engineering workflows.
• Support secure operation of data platforms through appropriate access controls and configuration standards.

• Document data architecture, integration patterns, platform configurations, and operational procedures.
• Maintain technical documentation and runbooks supporting data platforms and pipelines.
• Collaborate across software, integration, data, analytics, and network operations teams to support enterprise data initiatives.

Bachelor's degree in Computer Science, Engineering, or a related technical discipline with 8+ years of relevant experience. [Required]

• Hands-on experience designing, building, and maintaining ETL/ELT data pipelines and integrating multiple disparate data sources. [Required]
• Experience with data warehouse and/or data lake technologies such as AWS Redshift, Amazon S3, Hadoop, Snowflake, or similar platforms. [Required]
• Experience with Elastic Stack, including Elasticsearch, Logstash, and Kibana, and/or Kafka for data ingestion and processing. [Required]
• Experience with Linux/UNIX system administration and automation. [Required]
• Experience with CI/CD pipelines,…