Developer - Data Engineer

At Duke Health, we're driven by a commitment to compassionate care that changes the lives of patients, their loved ones, and the greater community. No matter where your talents lie, join us and discover how we can advance health together.

Pursue your passion for caring and innovation with Duke Heath Technology Solutions, which is dedicated to the transformation, development, and management of enterprise information technology solutions across Duke Health. By harnessing the power of innovative technologies like cloud computing and artificial intelligence - and pairing them with a forward‑thinking approach - Duke Health Technology Solutions is revolutionizing the future of health care at Duke Health and beyond.

The DHTS Developer is tasked with designing, developing, and optimizing databases and ETL pipelines, as well as managing servers and integrating APIs. This role involves working closely with data scientists and analysts to address data needs and implement effective data management solutions.

This role will assist with building data assets in Microsoft Fabric for use in Power BI. This includes building data models and semantic models.

• Individual contributor works under the direct supervision of level 3 or above and collaborates as a member of a team
• Basic understanding of local databases (Clarity; Caboodle) and underlying tables pertaining to role/domain
• Basic understanding of ETL technologies and scripting languages and terminology related to role
• Basic understanding of cloud data engineering technologies, including storage accounts, data pipelines, data lakes, structured vs. unstructured data, etc.
• Ability to design, construct and test data management systems under guidance of senior team members
• Assists in server administration tasks, ensuring system performance and availability
• Basic knowledge of SQL and relational databases
• Follows all policies and procedures set forth by DUHS/DHTS/ACE as pertains to role
• Responds to customer requests for assistance as assigned and prioritized by manager
• Participates in code review and learning best practices in data engineering
• Maintains ongoing communications (timely, clear, concise, and accurate) with manager keeping them apprised of request status
• Maintains appropriate project documentation as assigned such as GITLAB or data dictionary

• Meets all Competencies in Level 1
• Works with new hires/Level I team members to train on use of tools and technologies to accomplish job duties
• Demonstrates advanced knowledge of the assigned domain/role. Understands data, workflows, and tools related to role.
• Demonstrates advanced knowledge of, and experience with, cloud data engineering concepts, including (but not limited to) Microsoft Azure Lake houses and Delta Tables, Azure Data Factory, Azure Synapse, and medallion‑style data architecture.
• Demonstrates ability to work with stakeholders to understand business needs and perform business analysis independently >75% of the time.
• Develop technical requirements from business requirements independently >75% of the time.
• Can write/modify accurate SQL queries independently > 90% of the time
• Ability to optimize SQL queries, stored procedures and scripts for performance reliability
• Can write complex SQL inclusion/exclusion criteria for cohort development
• Manages and optimizes server infrastructure for performance and reliability
• Troubleshoot and resolve complex data pipeline, server and API issues
• Ability to locate data elements independently > 75% of the time
• Knowledge/utilization of basic data design and infrastructure
• Participates in team code review
• Actively participates/contributes to database QA/submit requests for new database tables/attributes
• Actively seeks out participation in Special Projects and is able to effectively accomplish project assignments with minimal supervision
• Ability to manage multiple projects to completion in a timely manner
• Ability to develop and present topics as assigned/needed by customer and/or ACE team
• Active participation in Duke Analytic Community or other networking forums applicable to job…