Databricks Engineer

Secret clearance is required (or the ability to obtain Secret Clearance)

Onsite 5 days/week - LOCAL is a must (Metro East / Southern IL)

Requirements:

• Secret clearance is required (or the ability to obtain Secret Clearance)
• Minimum of 3 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.
• Strong problem-solving skills and ability to solve complex data-related issues.
• Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
• Understanding of data modeling/visualization, database design principles, and data governance practices.
• Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
• Detail-oriented mindset with a commitment to delivering high-quality results.

Responsibilities:

• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
• Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
• Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
• Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
• Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
• Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
• Maintain documentation for software applications, workflows, and processes.
• Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.

• Seniority level
  
  Mid-Senior level

• Employment type
  
  Full-time

• Job function
  
  Information Technology and Other
• Industries Military and International Affairs and Information Services

Referrals increase your chances of interviewing at SBS Creatix by 2x

Medical insurance

Vision insurance

401(k)

Get notified when a new job is posted.

Scott AFB, IL $77,000.00-$90,000.00 1 month ago

Edwardsville, IL $82,212.00-$ 1 month ago

O'Fallon, IL $90,000.00-$ 1 day ago

O'Fallon, IL $90,000.00-$ 1 day ago

Scott AFB, IL $-$ 1 month ago

Scott AFB, IL $-$ 1 month ago

St Louis, MO $80,000.00-$ 3 days ago

St Louis, MO $-$ 3 days ago

St Louis, MO $89,700.00-$ 1 day ago

St Louis, MO $75,200.00-$ 1 week ago

Scott AFB, IL $86,000.00-$ 3 weeks ago

St Louis, MO $75,920.00-$ 6 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.