Software Engineer, Data Engineering, Python

Overview

Labor Category:
Software Engineer

Position Title:

Data & Software Engineer
Position Level: Level 3 – Senior

Location:

McLean VA
Core

Hours:

9am to 4pm
Salary:
Up to $ per year
Clearance:
Top Secret (TS/SCI) with Polygraph

• Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
• Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
• Leverage a background in large-scale data migration or platform modernization efforts
• Contribute to data engineering documentation, best practices, and design patterns

• Advanced Python programming skills; familiarity with Java
• Understanding of data security, privacy, governance and compliance principles
• History of building production data pipelines and ETL workflows at scale
• Experience:
  
  Building end-to-end data pipelines leveraging Python
• Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
• Containerizing and deploying applications in cloud environments like AWS
• Working with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for analytical workloads
• Git and Infrastructure as Code control; working with data catalogs and tracking data lineage
• Working with data formats including Geospatial;
  Bash scripting for automation
• Integrating AI/ML services and models

• Mandatory Requirements
• Developmental (0-2 years’ experience)
• Full Performance (3-5 years’ experience)
• Senior (6-10 years’ experience)
• Expert (11-15 years’ experience)
• SME (16+ years’ experience)

• Apache Spark & Py Spark
• Advanced Python skills (including Pandas & Num Py)
• Docker, Podman
• AWS S3, Lambda & Step Functions
• Apache Iceberg, Airflow, etc.
• SQL (with Trino)
• No
  
  SQL, DynamoDB
• Unity Catalog OSS, Apache Polaris
• Apache Superset
• Terraform or Cloud Formation
• Open Lineage
• H3, PostGIS

EI/OEE statements and applicable legal notices may apply as required.