Software Engineer - Data Ingest Team

Description

Interclypse is seeking a Software Engineer II to support a mission-critical data engineering effort on a project with the Department of Homeland Security's Cybersecurity and Infrastructure Security Agency (CISA). This role sits on a team responsible for data ingest — moving data from point A to point B across the pipeline. Current work includes Python-based data movement through AWS EMR, with an active transition to PySpark and SQL in Databricks, as well as building data flows from Databricks to a cloud-hosted Elasticsearch environment.

You'll work alongside dedicated Databricks and Elasticsearch subject-matter-expert teams, so deep specialization in either isn't required, but this role carries more independent ownership of pipeline design and troubleshooting than an entry-level position.

• Own and maintain data ingest pipelines, moving data reliably from source systems through to downstream destinations
• Work with existing Python code for AWS EMR-based data movement
  - Lead components of the ongoing migration of data pipelines from EMR/Python to PySpark and SQL in Databricks
• Build and support data flows from Databricks to a cloud-hosted Elasticsearch environment
• Collaborate with dedicated Databricks and Elasticsearch SME teams to design and troubleshoot pipeline components
  - Troubleshoot production issues across AWS, Databricks, and Elasticsearch
• Evaluate and improve the quality of existing pipeline software and integrations
• Document technical processes and data flows
• Ensure compliance with relevant federal security standards (e.g., NIST, FISMA)
• Conducts software validation, verification, and software engineering anomaly resolution
• Evaluates the quality of proposed and existing software systems/solutions supporting cyber software activities integrated into various networks and architectures
• Designs, develops, enhances, debugs, integrates, and implements software
• Troubleshoots production problems related to software applications
• Researches, tests, builds, and coordinates conversion/integration of new products based on user requirements
• Designs or implements complex algorithms requiring adherence to strict timing, system resource, or interface constraints; performs quality control on team products
• Confers with system and hardware engineers to derive requirements and obtain information on project limitations, capabilities, performance requirements, and interfaces

Interclypse provides a uniquely cultivating environment where mentorship and continued learning create extraordinary professionals. Our goal is to empower our talent by putting you in the driver’s seat of your career.

Software Engineering candidates have experience working in team environments, building software solutions for customers, and are looking to take their careers to the next level. Familiarity with the following tech stacks below is great but not a requirement.

• 4–6 years of applications development experience with a High School Diploma;
  * or* a bachelor's degree in Computer Science, Cybersecurity, Computer Engineering, or related technical discipline with 2–4 years of applications development experience
• Working knowledge of core AWS services
• Solid hands-on experience with Python
• Working familiarity with Databricks (SME support available for deeper specialization)
• Ability to troubleshoot production issues independently
• Strong written and verbal communication skills

• Experience with PySpark or SQL-based data transformation
• Familiarity with AWS EMR or similar big-data processing services
• Exposure to Elasticsearch or other search/indexing platforms
• Experience working on federal government contracts, particularly with DHS or CISA
• Familiarity with NIST cybersecurity frameworks and federal compliance requirements (FISMA, FedRAMP)

• You’re tired of working for a massive organization.
• You want to work for an established company that values your stable career.
• You want to work with a team that loves their job and making cool stuff.
• You want to be part of a team focused on making a positive impact.
• You want to grow your skills in management or work…