Senior Data Engineer

Overview

Mode
:
Remote

Contract
: B2B

Summary: The Senior Data Engineer role is crucial for enhancing data products, focused on improving data management processes to support patient care and organizational goals.

• Collaborate with cross-functional teams to design, develop, and maintain data pipelines and analytics solutions.
• Design and build a foundational platform for a modern data lake architecture, optimizing it for scalability, flexibility, and performance.
• Develop automated tests to ensure data accuracy and quality.
• Continuously secure improvement to enhance developer efficiency and act as a sparring partner on the use of Azure services for the organization.
• Leverage cloud development expertise to design and implement digital solutions focused on business insights and patient care.

• Extensive experience with Azure, Azure Databricks, and a deep understanding of Azure architecture and services.
• Strong proficiency in Python programming.
• Experience using Spark, including Spark SQL, with an understanding of how to optimize Spark performance.
• Automated unit testing and code quality inspection experience.
• Experience with CI/CD (Git Hub actions / Azure Dev Ops).
• Familiarity with AWS.
• Experience in the pharma domain or other regulated areas.

• Proven ability to work in a collaborative team environment.
• Willingness to receive and act on feedback for personal and professional growth.
• Fluency in English, both written and spoken.

• Team Structure - Collaborative team focused on innovation in patient care.