Senior Data Engineer

Work Location:

Belfast, United Kingdom

Hours:

35 Line of Business:
Technology Solutions Pay Details:
We’re committed to providing fair and equitable compensation to all our colleagues. As a candidate, we encourage you to have an open dialogue with a member of our HR Team and ask compensation related questions, including pay details for this role.

The TDS Research Technology team is responsible for delivering the data, analytics, and AI platforms that support Research business capabilities globally. From Belfast, this role will help build the strategic Research data platform leveraging Databricks, enabling reusable data products, modern analytics, and future AI solutions across the organization.

We are seeking a Senior Data Engineer to help build and evolve the strategic Research data platform in Databricks. Working as part of a global Research Technology team, this role will focus on developing scalable data pipelines, governed data products, and foundational capabilities that support analytics, BI reporting, and AI initiatives. The successful candidate will bring a strong combination of hands-on engineering expertise and delivery leadership, acting as a key liaison between global business stakeholders and technology teams to drive successful execution and platform adoption.

• Work as part of a Belfast-based data engineering team contributing to globally used Research data platforms, products, and services.
• Build the foundational Research data platform that will serve as a strategic data and AI enabler for the Research business.
• Design, develop, and maintain scalable data pipelines using Python, SQL, Spark, Databricks, Azure, and related cloud data technologies.
• Create curated, reusable, and governed data products that can be consumed by Research applications, dashboards, reporting tools, and AI-enabled solutions.
• Support data ingestion and transformation patterns across structured, semi-structured, and unstructured data sources where required.
• Contribute to data domain, table, object, field, and metadata structures that align with Unity Catalog and broader data governance patterns.
• Implement data quality, reconciliation, lineage, monitoring, audit, and operational controls required for production‑grade data platforms.
• Support CI/CD, automation, deployment, and environment management practices for Databricks and Azure‑based data workloads.
• Partner closely with global engineering colleagues, business stakeholders, platform teams, and data consumers to translate requirements into scalable data solutions.
• Act as a coordination bridge with Cognizant resources in India, using the Belfast time zone overlap to support delivery alignment, issue resolution, and execution follow‑through.
• Communicate effectively, contribute to design discussions and demos, and support a collaborative global delivery model.

• 10+ years of experience in data engineering, data platform delivery, software engineering, or related enterprise technology roles.
• Strong hands‑on experience with Databricks, Spark / PySpark, Python, SQL, Delta Lake, Azure, ADLS, and cloud‑based data engineering patterns.
• Experience designing scalable data pipelines, data products, and lakehouse solutions using modern cloud data platform patterns.
• Experience with Unity Catalog or similar governance capabilities, including data discovery, access control, lineage, ownership, and catalog structures.
• Experience delivering enterprise‑grade data platforms including CI/CD, monitoring, data quality, operational controls, and support processes.
• Strong analytical and problem‑solving skills, with the ability to work through complex data, platform, and integration challenges.
• Strong…