Senior Data Engineer; Python

Overview

As a Data Engineer (Python), you will play a key role in building, testing, and operating scalable data products and machine learning solutions. You’ll work closely with data scientists, engineers, and business stakeholders to design robust data pipelines, ensure high data quality, and support production-ready deployments. In this role, you’ll contribute across the full data lifecycle — from ingestion and transformation to deployment, testing, and operational support.

You’ll also help strengthen our IT governance processes through code reviews and collaboration, while continuously improving automation and reliability within our data platform.

• Build, test, and operate scalable data products and machine learning solutions.
• Design robust data pipelines with data scientists, engineers, and business stakeholders.
• Ensure high data quality and support production-ready deployments.
• Contribute across the full data lifecycle — from ingestion and transformation to deployment, testing, and operational support.
• Help strengthen IT governance through code reviews and collaboration, while improving automation and reliability within the data platform.

• Strong experience with Python, including PySpark and pandas
• Solid knowledge of SQL for data transformation, validation, and testing
• Hands-on experience with Azure Dev Ops, especially CI/CD pipelines
• Experience implementing automated tests (e.g. pytest, SQL-based tests) for data products and machine learning models
• Ability to design and implement data ingestion pipelines (initially as a Proof of Concept)
• Strong understanding of data quality principles, with the ability and willingness to dive into business logic
• Experience supporting operational activities in a production environment
• Comfortable reviewing pull requests and contributing to IT governance and code quality standards

• Experience with Databricks, ideally including Databricks Asset Bundles
• Exposure to Power BI, with potential to support deployment of dashboards in the future
• Familiarity with deploying and operating machine learning models in a data platform