Junior Data Engineer
Listed on 2026-07-18
-
Software Development
Python, Data Engineering
Job Summary
The Junior Data Engineer supports system-specific implementations that enable enterprise ingestion by assisting in the design, build, and operation of automated metadata harvesting pipelines that populate DHA-EDC content on reliable schedules. This role focuses on hands‑on engineering using SQL/Python/R to develop connectors and extraction scripts, implement validation rules, and configure refresh frequencies to support completeness, accuracy, and timeliness of harvested metadata.
Working closely (in-person and virtually) with source system SMEs, the Junior Data Engineer helps safely extract metadata from authorized sources and escalates tool constraints and design decisions to Architects within the approved architecture. In support of an automated metadata harvesting and documentation, this role contributes to building and orchestrating metadata extraction pipelines to ensure timely population of DHA-EDC content.
- Assisting in engineering metadata harvesting pipelines (SQL/Python/R), connectors, validation rules, and refresh frequencies for system‑specific implementations supporting enterprise ingestion.
- Collaborating in‑person/virtually with source system SMEs to safely extract metadata from relevant sources and validate results during review cycles.
- Supporting implementation and testing of automated metadata harvesting tools and ETL/ingestion workflows to enable real‑time or scheduled extraction.
- Implementing validation checks to help measure metadata completeness, accuracy, and timeliness, including coverage reporting and issue flagging for remediation.
- Participating in defect triage and troubleshooting for failed harvest runs, refresh delays, or validation errors; documenting findings and supporting re‑runs after fixes.
- Co‑developing the metadata harvesting plan with Architects and program stakeholders; translating requirements into build tasks and technical documentation.
- Producing and maintaining technical documentation for pipelines, connector configurations, validation logic, and refresh schedules to support sustainment and knowledge transfer.
- Must be able to obtain and maintain a Federal or DoD “PUBLIC TRUST”. Candidates with an ACTIVE SECRET CLEARANCE OR PUBLIC TRUST or SUITABILITY are preferred. Ability to meet the project’s client security and access requirements.
- Bachelor’s degree obtained.
- 3 years of experience (or strong internship/coop experience) in data engineering, ETL/ELT, or pipeline development using SQL and Python.
- Working proficiency in SQL and Python; familiarity with R is a plus for statistical validation and profiling.
- Familiarity with building or supporting connectors/extractors (e.g., relational sources, APIs, file‑based repositories) and running scheduled jobs.
- Ability to collaborate with technical SMEs and follow structured validation and documentation processes.
- Once onboard with Guidehouse, new hire MUST be able to obtain and maintain a Federal or DoD “Secret” security clearance.
- Strong written and verbal communication skills; ability to document technical work clearly and elevate issues appropriately.
- Bachelor’s degree in computer science, Information Systems, Engineering, or a related field (or equivalent practical experience).
- Exposure to metadata/catalog patterns (e.g., metadata harvesting, catalog population concepts, lineage/semantic discovery concepts).
- Hands‑on experience performing data engineering related to metadata harvesting efforts.
- Hands‑on experience with leading data cataloging solutions such as Collibra, Alation, Unity Catalog, Azure Purview, or AWS Glue.
- Experience supporting testing/validation workflows (e.g., rule‑based checks, completeness/accuracy/timeliness metrics, defect tracking).
- Familiarity working in Agile delivery teams and using backlog/issue tracking tools.
- Prior experience in federal health, healthcare.
Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.
Benefits include:
- Medical, Rx, Dental & Vision…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).