Senior Data Engineer

We’re an innovation and transformation consultancy that believes in the power of ingenuity to build a positive‑human future in a technology‑driven world. Our diverse teams of experts combine innovative thinking with breakthrough technologies to progress further, faster.

Are you ready to harness the power of data to drive advancements in healthcare? Are you passionate about both developing new capabilities and ensuring the optimization and reliability of existing data systems? Are you passionate about designing, building, and operating data infrastructure that plays a pivotal role in improving patient outcomes and shaping the future of medicine?

If you’re seeking a rewarding career at the intersection of healthcare and technology, we invite you to be part of our dynamic team. This is a unique, multi‑year, project‑based opportunity to build and grow a clinical data registry platform over many years working with a dedicated team of collaborators and customers.

As a Data Engineer for our cutting‑edge medical data registry, you’ll be at the forefront of managing, optimizing, and expanding our data infrastructure, enabling critical insights that can positively impact patient outcomes. This role provides a dynamic mix of innovative new development—enhancements, optimizations, and Proofs of Concept—alongside meaningful hands‑on ownership of production pipelines, data flows, and platform operations.

You will contribute to system improvements while also owning the monitoring, troubleshooting, tuning, and day‑to‑day reliability of the existing data ecosystem. If you’re excited about leveraging your data engineering skills to make a difference in the world of healthcare, we want to hear from you.

At least 8 years of industry working experience as a data engineer.

• Advanced SQL and Python
• Expertise in the design and construction of Big Data Lakes and Data Warehouses capable of ingesting, standardizing, and serving billions of data rows spanning diverse datasets ranging from tens to hundreds
• Experience building dynamic, metadata driven pipelines and analyses
• Experience maintaining and supporting production data systems, including pipeline monitoring, troubleshooting, and delivering long‑term reliability and optimization enhancements
• Building and managing fully automated data pipelines (ETL, ELT, ELTL) including:
  • Designing and building data interfaces to source systems
  • Combining and transforming data into the appropriate format for storage
  • Developing data sets for analytics purposes
  • Developing pipelines that can handle common issues/errors in a robust and automated way
  • Implementing data quality checks, observability, and cost/performance optimization
• Cloud experience in Azure, AWS or GCP
• Ability to balance enhancement work with operational responsibilities in a production environment

• Spark / PySpark experience highly preferable
• Working in Agile and Dev Ops environments
• Basic Python, Bash, or Power Shell for automation
• Data visualisation in Power BI, Tableau, Qlik or similar
• Architecting Data Platforms - designing BI/MI/Analytics solutions using Big Data, Relational or Streaming technologies
• Experience with monitoring/observability tools (logging, alerting, pipeline health dashboards)
• One or more of the following certifications:
  • Microsoft Certified:
    Azure Data Engineer Associate
  • AWS Certified Data Analytics - Specialty
  • GCP Professional Data Engineers

Life At PA encompasses our peoples’ experience 's about how we enrich peoples’ working lives by giving them access to unique people and growth opportunities and purpose led meaningful work.

We are currently operating a discretionary hybrid working model which is designed to help you plan your work and your life. We want our people to come into the office at least two days a week.

Our purpose guides how we work with our clients and our teams, and support our communities, to deliver insight and impact, solving the world’s most complex challenges. We're focused on building a workplace that values human difference and diverse mindsets, and a culture of inclusion and equality that unlocks the potential in our people so everyone can be…