More jobs:
Lead Data Engineer
Job in
Minneapolis, Hennepin County, Minnesota, 55400, USA
Listed on 2026-07-01
Listing for:
Perficient
Full Time
position Listed on 2026-07-01
Job specializations:
-
Software Development
Python, Data Engineering, SQL Developer
Job Description & How to Apply Below
We are seeking a Senior Data Engineer (open to Principal level) to lead the modernization and ownership of a critical data pipeline within a large-scale healthcare analytics environment. This role will focus on transitioning legacy SAS-based pipelines to modern Python/PySpark on Databricks
, while driving engineering best practices and scalable data solutions.
This is a hands‑on engineering role with a strong emphasis on development capabilities. Candidates with application development experience and exposure to AI/automation technologies will stand out.
Key Responsibilities- Lead the modernization of data pipelines from SAS to Python/PySpark on Databricks
- Own and evolve a mission‑critical HEDIS data pipeline used for performance measurement and reporting
- Design, build, and optimize scalable data pipelines in a distributed environment
- Collaborate with SMEs during an initial knowledge transfer period
, with eventual full pipeline ownership - Develop, schedule, and automate end‑to‑end data workflows
- Ensure data quality, reliability, and performance across large datasets
- Partner with cross‑functional teams and analytics vendors to deliver high‑quality data outputs
- Contribute to best practices in version control, CI/CD, and agile development workflows
- Hands‑on experience with Python (scripting and application development)
- Expertise in building and managing data pipelines and ETL workflows
- Proficiency with Databricks (notebooks, workflows, cluster management)
- Solid experience with AWS services including S3, Lambda, Glue, and EC2
- Strong SQL skills for complex transformations and data extraction
- Experience with pipeline orchestration and automation
- Familiarity with version control systems (Git) in a collaborative environment
- Experience managing work via issues, epics, and agile tooling
- Experience with AI, machine learning, or automation frameworks
- Background in transitioning legacy systems to modern data platforms
- Application development experience, especially Python scripting
- Expertise in AI or automation (highly desirable bonus)
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×