Senior Pipeline Engineer

Senior Pipeline Engineer – Join to apply at Jobs via Dice

2 days ago – Be among the first 25 applicants

Job Description

ECS is seeking a Senior Pipeline Engineer to work remotely. ECS is looking for professionals to join our team in building the next-generation Continuous Diagnostics and Mitigation (CDM) Cyber data solution. The CDM Program is the Cybersecurity and Infrastructure Security Agency’s (CISA) dynamic approach to strengthening the cybersecurity of Federal networks and systems through better awareness and visibility into their security posture and cyber threats.

ECS designs, builds, deploys, operates, and maintains a complete 'Data Services' solution that includes the collection, normalization, visualization, and sharing of cyber data from more than 100 Federal agencies. The CDM Data Services product is an integrated suite of multiple Commercial Off the Shelf (COTS) products, software configuration packages, and custom code tailored to meet Department of Homeland Security (DHS) requirements.

We are seeking professionals who thrive in a dynamic, fast‑paced, highly collaborative environment where problem‑solving, critical thinking, and a holistic approach to serving the mission are key. Our program operates within the Scaled Agile Framework (SAFe). An aptitude and enthusiasm for continuous learning, improvement, and cyber security is a must.

ECS is looking for a senior engineer/Dev Op to support the development of an integrated solution to collect and visualize cyber security related data. This position will work as part of an agile development team and will be expected to master multiple products and problem domains as well as develop in Python.

Candidate must be a problem solver, who enjoys the challenge of tackling technical tasks and problems with little oversight. The solution is rapidly evolving with new and changing requirements, technologies, and threats. Successful candidates will have a strong aptitude for discovering and implementing new products and demonstrated experience writing supported code. They should also have a solid understanding of application architecture and interfaces as well as experience with data modeling, hands‑on configuration, performance tuning, and monitoring/optimizing of distributed data storage stacks (e.g. Elasticsearch).

Salary Range
: $120,000 – $180,000

Required Skills

• 5+ years of experience designing and supporting cloud‑based solutions with a preference for AWS knowledge.
• 5+ years of experience working with containerization:
  Docker, Kubernetes, AWS ECR/ECS/EKS/Fargate, and container registries.
• 5+ years of experience with systems integration (e.g., moving data from one system to another, integrating functions between applications, working with APIs, advanced level expertise with scripting languages, Python preferred).
• 5+ years' experience leading technical analysis efforts, evaluating new methodologies and technologies, and making recommendations that meet requirements and optimally deliver technical capabilities.
• 5+ years creating microservice‑based applications utilizing modern tools and components.
• 5+ years leveraging Git code repositories (e.g. Git Hub, Bitbucket) and actions.
• 5+ years incorporating Continuous Integration / Continuous Delivery (CI/CD) capabilities into the development lifecycle.
• Advanced level expertise querying data to include aggregations, calculations, and producing metrics from data.
• Advanced level expertise with one or more message queuing systems (Rabbit
  
  MQ, SQS, etc.).
• Advanced knowledge experience with distributed event streaming systems (Kafka preferred).
• Intermediate level expertise creating data pipelines to include ETL/ELT and streaming data such as log data or tool/sensor data to indices; experience with Splunk forwarders, Kafka, Logstash, Beats, or ES/python.
• Intermediate level expertise with data models and databases (relational and No
  
  SQL).
• Excellent written and oral communication; comfortable presenting information both internally and to customers.
• Experience with automation and configuration management tools (Jenkins, Ansible, Ant).

Desired Skills

• Experience working with cyber security tools, technologies, and missions.
• Understan…