Senior Data Engineer

Tower Point, 6th Floor, 27-43 Wormwood Street, Boston, MA 02210, United States of America, Boston 02210, US

We believe in the power of ingenuity to build a positive human future.

As strategies, technologies, and innovation collide, we create opportunity from complexity.

Our diverse teams of experts combine innovative thinking and breakthrough technologies to progress further, faster. Our clients adapt and transform, and together we achieve enduring results.

We are over 4,000 strategists, innovators, designers, consultants, digital experts, scientists, engineers, and technologists. And we have deep expertise in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport.

Our teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands.

PA. Bringing Ingenuity to Life

Your day to day

We’re an innovation and transformation consultancy that believes in the power of ingenuity to build a positive-human future in a technology-driven world. Our diverse teams of experts combine innovative thinking with breakthrough-technologies to progress further, faster.

Are you ready to harness the power of data to drive advancements in healthcare? Are you passionate about both developing new capabilities and ensuring the optimization and reliability of existing data systems? Are you passionate about designing, building, and operating data infrastructure that plays a pivotal role in improving patient outcomes and shaping the future of medicine?

If you're seeking a rewarding career at the intersection of healthcare and technology, we invite you to be part of our dynamic team. This is a unique, multi-year, project-based opportunity to build and grow a clinical data registry platform over many years working with a dedicated team of collaborators and customers.

As a Data Engineer for our cutting-edge medical data registry, you'll be at the forefront of managing, optimizing, and expanding our data infrastructure, enabling critical insights that can positively impact patient outcomes. This role provides a dynamic mix of innovative new development—enhancements, optimizations, and Proofs of Concept—alongside meaningful hands-on ownership of production pipelines, data flows, and platform operations.

You will contribute to system improvements while also owning the monitoring, troubleshooting, tuning, and day-to-day reliability of the existing data ecosystem. If you're excited about leveraging your data engineering skills to make a difference in the world of healthcare, we want to hear from you.

• At least 6 years of industry working experience
• Advanced SQL and Python
• Expertise in the design and construction of Big Data Lakes and Data Warehouses capable of ingesting, standardizing, and serving billions of data rows spanning diverse datasets ranging from tens to hundreds
• Experience building dynamic, metadata driven pipelines and analyses
• Experience maintaining and supporting production data systems, including pipeline monitoring, troubleshooting, and delivering long‑term reliability and optimization enhancements
• Building and managing fully automated data pipelines (ETL, ELT, ELTL) including:
  • Designing and building data interfaces to source systems
  • Combining and transforming data into the appropriate format for storage
  • Developing data sets for analytics purposes
  • Developing pipelines that can handle common issues/errors in a robust and automated way
  • Implementing data quality checks, observability, and cost/performance optimization
• Cloud experience in Azure, AWS or GCP
• Ability to balance enhancement work with operational responsibilities in a production environment

Preferred qualifications

• Spark / PySpark experience highly preferable
• Working in Agile and Dev Ops environments
• Basic Python, Bash, or Power Shell for automation
• Data visualisation in Power BI, Tableau, Qlik or similar
• Architecting Data Platforms - designing BI/MI/Analytics solutions using Big Data, Relational or Streaming technologies
• Experience with monitoring/observability tools (logging, alerting, pipeline health dashboards)
• One or more of the following…