Senior Data Engineer

Overview

We are seeking an experienced Senior Data Engineer to support a federal client in advancing enterprise-scale analytics and data-driven decision-making. The ideal candidate will design, build, and optimize cloud-based data pipelines using Python, SQL, and modern ETL frameworks, while collaborating with analysts and developers to deliver scalable, reliable, and secure data solutions through CI/CD and automation best practices.

• Build, test, and orchestrate data pipelines in Python
• Design and optimize data structures, schemas, and ETL processes
• Translate business use cases into SQL queries, reports, and dashboards
• Manage database objects in development environments without impacting production
• Automate workflows using Databricks Workflows or the Jobs API
• Integrate code into Git Hub/Git Lab and support CI/CD practices
• Diagnose data gaps and quality issues and design test cases for validation
• Collaborate with developers and analysts to synchronize code and ensure reliability

• Bachelor’s in computer science, Data Engineering, or related field
• 7+ years of professional experience in data engineering
• Expert-level proficiency in Databricks, Apache Spark, and SQL
• Proficiency in Python and SQL (2–3 years each)
• Experience with ETL tools such as Kafka, Airflow, or AWS Glue
• Skilled in CI/CD pipelines and Git Hub/Git Lab version control
• Familiarity with cloud platforms (AWS, Azure, or GCP)
• Strong problem-solving, debugging, and collaboration skills