Data Engineer

Job Title

Data Engineer (All Levels)

Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense sector. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.

• Design, develop, and implement end‑to‑end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high‑performance processing.
• Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
• Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
• Troubleshoot data‑related problems and provide innovative solutions to address complex data challenges.
• Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
• Work closely with cross‑functional teams to understand data requirements and design optimal data models and architectures.
• Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision‑making processes.
• Maintain documentation for software applications, workflows, and processes.
• Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.

• Secret clearance or higher required (can be sponsored).
• Strong SQL knowledge:
  Ability to write, troubleshoot, and modify complex SQL procedures and queries across a variety of datasets.
• Experience with Extract, Transform, Load (ETL) processes and maintaining data load processes as well as manipulating and combining various data sources.
• Business Intelligence experience:
  Creating and updating applications, reports, dashboards, especially in Cognos Analytics, Qlik Sense, and Power BI.
• Hands‑on experience with Python, Spark, Scala, JavaScript/JSON, and SQL.
• Familiarity with Databricks, Amazon AWS/S3, and Jupyter Notebooks.
• Strong problem‑solving skills and ability to solve complex data‑related issues.
• Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
• Understanding of data modeling/visualization, database design principles, and data governance practices.
• Excellent communication and collaboration skills, with the ability to work effectively with cross‑functional teams.
• Detail‑oriented mindset with a commitment to delivering high‑quality results.
• Teradata experience is a plus.
• Accounting knowledge is a plus; background in DoD accounting systems (DEAMS, TFMS, NERP, etc.) and transportation policies is helpful.

• Competitive salary and bonus based on performance.
• Retirement plan: 401(k) matching up to 6% and access to Vanguard Admiral funds.
• Health, dental, and vision insurance for employees and families.
• Paid time off based on length of service.
• Professional development: support for training programs and certifications.
• Company retreats and team events.
• Opportunity for advancement.
• Training and development programs.

• Seniority level:
  Not Applicable
• Employment type:
  
  Full‑time
• Job function:
  Information Technology
• Industries:
  Business Consulting and Services

Referrals increase your chances of interviewing at Silverthorne Advisory Group by 2x.