Databricks Engineer, Mid

We are looking for a mid-level Databricks Engineer to support mission‑critical data initiatives for defense, intelligence, and civil clients. The role involves designing, building, and maintaining scalable data pipelines in modern cloud environments, enabling analytics, AI, ML, and decision advantage at scale.

• Build and optimize ELT or ETL pipelines using Databricks Notebooks, Delta Live Tables (DLT), Workflows, and Unity Catalog.
• Implement data ingestion, transformation, and quality processes with PySpark, Spark SQL, and Delta Lake best practices such as incremental merges, ACID transactions, and SCD patterns.
• Collaborate with data scientists, analysts, and mission stakeholders to understand requirements and deliver reliable, governed data assets.
• Support data platform operations, monitor pipeline performance, troubleshoot issues, and contribute to cost optimization, including leveraging the Photon engine.
• Contribute to medallion architecture implementations – bronze, silver, and gold – in cloud storage environments such as Azure ADLS or AWS S3.
• Document pipelines, data models, and processes to ensure maintainability and knowledge transfer.
• Learn and apply emerging Databricks capabilities to advance client missions.

• 2+ years of experience in data engineering, software development, or analytics engineering.
• Experience with Databricks, including notebooks, Delta Lake, Workflows, or DLT.
• Writing SQL queries for data analysis and transformation.
• Python programming for scripting and data manipulation.
• Knowledge of distributed data processing concepts such as Spark fundamentals, including partitioning, caching, and shuffle.
• Ability to work in a team environment and communicate technical concepts to non‑technical stakeholders.
• U.S. citizenship and ability to obtain a Public Trust or Suitability/Fitness determination based on client requirements.
• Bachelor’s degree in CS, Engineering, Information Systems, or Mathematics.

• Experience with cloud platforms such as Azure, AWS, or GCP, and object storage.
• Experience with orchestration tools such as Databricks Workflows, Airflow, or dbt.
• Experience with streaming data processing or real‑time pipelines.
• Knowledge of Git for version control and collaborative development.
• Knowledge of data governance concepts, including Unity Catalog and access controls.
• Databricks Certified Data Engineer Associate Certification.

• Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client.
• Due to the nature of work performed within this facility, U.S. citizenship is required.

Salary range: $62,000 – $141,000 (annualized USD). Benefits include health, life, disability, financial, and retirement benefits; paid leave; professional development; tuition assistance; work‑life programs; and dependent care.

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran, or any other status protected by applicable federal, state, local, or international law.