Information Technology_USA - USA_Developer
Washington, District of Columbia, 20001, USA
Listed on 2026-06-27
-
Software Development
Data Engineering
Data Engineer
Location:
Washington, DC - Remote position but candidate may have to travel onsite to DC occasionally based on need.
Duration: 6 months
Skills:
8-10+ years experience required
MySQL
Databricks
Pyspark
Design and develop scalable ETL/ELT pipelines using Databricks and PySpark.
Build batch and real-time streaming ingestion frameworks.
Develop reusable ingestion and transformation frameworks.
Implement Medallion architecture (Bronze, Silver, Gold layers).
Develop incremental and CDC-based ingestion pipelines
Design and implement real-time streaming pipelines using Kafka and Structured Streaming.
Optimize Spark jobs, SQL queries, and streaming pipelines.
Implement Delta Lake-based ingestion and transformation frameworks.
Tune partitioning, caching, and Spark execution strategies.
Strong SQL and data modeling skills.
Experience with cloud platforms and distributed systems.
Familiarity with CI/CD pipelines and Dev Ops practices.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).