Data Engineer- PennDnA- Quality; Mid level​/Senior

Position: Data Engineer- PennDnA- Quality (Mid level/Senior)
Description
Penn Medicine is dedicated to our tripartite mission of providing the highest level of care to patients, conducting innovative research, and educating future leaders in the field of medicine. Working for this leading academic medical center means collaboration with top clinical, technical and business professionals across all disciplines.

Today at Penn Medicine, someone will make a breakthrough. Someone will heal a heart, deliver hopeful news, and give comfort and reassurance. Our employees shape our future each day. Are you living your life's work?

• Entity:
  Corporate
• Department:
  PennDnA Data Management & Operations
• Location:
  
  3600 Civic Center Blvd. Philadelphia, PA
• Hours:
  
  8hr Days (Mostly remote; some in person meetings)

Summary:

This position is posted at two levels based on experience:

• Data Engineer
  - PennDnA
• Senior Data Engineer
  - PennDnA

Candidates will be aligned to the appropriate level based on experience and qualifications.

Data Engineer PennDnA:

The Data Engineer Penn DnA works as part of a team to design, develop, and maintain robust data pipelines, ETL/ELT processes, and data transformation solutions. This role requires technical expertise in data engineering and a commitment to delivering high-quality work products in a timely manner.

Responsibilities

• Data Integration and Processing:
  Design, develop, and implement scalable data pipelines to ingest, process, and transform diverse datasets from various sources including electronic health records (EHR), clinical systems, research databases, and external sources.
• ETL/ELT Development:
  Build and optimize ETL/ELT processes and work within Cloud technology such as AWS, Azure and/or Databricks to ensure efficient data extraction, transformation, and loading while maintaining data quality, consistency, and integrity. Collaborate with stakeholders to understand data requirements and translate them into effective ETL/ELT solutions.
• Data Quality Management:
  Perform data cleansing, transformation, and validation to ensure data accuracy and integrity. Execute troubleshooting and resolving data-related issues and challenges. Implement data governance best practices to ensure compliance with regulatory requirements and institutional policies related to data privacy, security, and confidentiality.
• Performance Monitoring:
  Monitor performance of data pipelines and ETL/ELT processes, troubleshoot issues, and implement optimizations to improve efficiency, reliability, and scalability.
• Documentation:
  Develop and maintain documentation for data pipelines, ETL/ELT workflows, and data transformation processes to facilitate knowledge sharing and ensure reproducibility.
• Collaboration:
  
  Collaborate with cross-functional teams to understand project requirements and develop solutions that meet organizational needs. Provide regular project updates to team members and stakeholders. Foster professional relationships with colleagues and contribute to a collaborative work environment.
• Continuous Improvement:
  Demonstrate a commitment to continuous learning and professional development. Look for opportunities to optimize ETL/ELT, data governance and transformation, and troubleshooting processes and workflows.
• Performs duties in accordance with Penn Medicine and entity values, policies, and procedures
• Other duties as assigned to support the unit, department, entity, and health system organization

Credentials:

• Epic Clarity Data Model (must be completed within 6 months of start date)

Education or Equivalent

Experience:

• Bachelor's Degree Computer Science, Information Systems, or related field Or 4+ years Related experience
• 2+ years Experience in data engineering, utilizing programming skills to build robust data pipelines and dynamic systems. Proven track record of managing and executing projects with minimal oversight. Understanding of SLDC processes including CI/CD approaches.
• 1+ years Experience working with data from Electronic Health Records (EHRs) preferred.

Senior Data Engineer:
PennDnA

The Senior Data Engineer will be responsible for designing, developing, and maintaining robust data pipelines, ETL/ELT processes, and other data cleansing and transformation solutions to support…