Databricks Data Engineer and Scientist

Databricks Data Engineer and Scientist

The Opportunity:

As a Databricks Data Engineer and Scientist, you will design, build, and maintain robust data pipelines for a critical enterprise Lakehouse, applying your data science, AI, and analytics skills. You will develop and optimize end-to-end data flows, manage ETL processes, design data models, help ensure data security and compliance, collaborate with cross-functional teams, and improve performance and scalability. Your experience with Databricks and AWS, along with your SQL, Python, and AI-assisted coding skills, will help you analyze pipelines, support data modeling, and turn raw data into actionable insights across the business.

Work with us to use data for good.

Join us. The world can’t wait.

You Have:   8+ years of experience designing, developing, deploying, and managing ETL processes and data pipelines, with comprehensive logging and error handling to troubleshoot and resolve issues3+ years of experience building, debugging, and optimizing data pipelines using Databricks notebooks, clusters, and job orchestration tools, including Delta Lake and Unity Catalog3+ years of experience writing Python and PySpark code for ETL scripts and custom transformations

Experience using AI-assisted coding tools such as Claude Code or Cursor to support data engineering and data modeling tasks

Experience with data modeling, including selecting dimensional or relational models, within a Bronze, Silver, and Gold medallion architecture

Experience using AWS services, including AWS Glue, Amazon S3, and Amazon RDS Knowledge of ETL performance optimization techniques, such as partitioning, bucketing, and caching, and experience troubleshooting query performance

Ability to analyze and decompose complex legacy SQL, rebuild data pipelines or models, and compare results to validate accuracy and performance

Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements

Bachelor’s degree in Computer Science, Computer Engineering, Engineering, Math, Physics, or Information Systems and Technology Nice If You Have: 

  Experience with AWS cloud-native data services such as AWS Lambda or Amazon Cloud Watch that support serverless data processing

Experience with metadata and data cataloging tools such as AWS Glue Data Catalog or Collibra to manage data assets and lineage

Knowledge of data governance, data lineage, and compliance requirements such as GDPR and CCPA that support data quality, privacy, and security

Ability to explain complex technical concepts to non-technical audiences, including architectural tradeoffs

Vetting:

Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client.

Compensation At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs.

Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Salary at Booz Allen is determined by various factors, including but not limited to location, the individual’s…