Data Engineer

Data Engineer (6 Month Fixed Term Contract)

Final date to receive applications: 28 June 2026

Department: Operations

Employment Type: Fixed Term Contract

Location: London

Compensation: £47,000 - £50,882 / year

Overview of team purpose

The Technology and Data department ensures that London & Partners maintains a secure, scalable and resilient technological ecosystem that underpins the organisation’s strategic goals and daily operations. We promote the effective use of technology and data, fostering collaboration to drive innovation, enhance internal processes and support informed decision‑making across the organisation.

As a Data Engineer, you will be instrumental in the technical delivery of the Data Strategy. Working with the Business and Data Analytic Lead, you will support the transformation of how the organisation uses data to improve insight and decision making. We are at the start of our data transformation and need a bright self‑starter who is happy to roll up their sleeves and get involved in building our foundational data structures from the ground up.

You will help set up foundational components including data governance, quality, and process validation. You will work with business and technical teams to improve automation, data warehousing and ethical AI capabilities.

You are responsible for managing the data architecture that allows colleagues to access and use trusted data independently. This work helps create a culture of self‑service and data‑led decisions. Your contribution will provide timely insights that support strategic objectives such as the London Growth Plan, key metrics like GVA and NPS, and required regulatory or funding reporting.

Pipeline and Systems Management

• Design and maintain automated ETL/ELT processes to integrate data from core systems and APIs.
• Support the technical setup and daily maintenance of a central Data Lake for structured and unstructured data.
• Perform regular validation checks across systems to ensure data stays synchronised.

Reporting and Insight Support

• Implement and maintain the data architecture required to support the Insights and Policy teams with their strategic reports.
• Collaborate with colleagues to develop and promote a self‑service reporting approach across the organisation.
• Automate the delivery of performance indicators, such as GVA and NPS, to ensure real‑time access for leaders and managers.

Process Automation and Efficiency

• Identify and implement ways to automate manual data validation to reduce the use of external spreadsheets.
• Streamline workflows to minimise repetitive data entry and improve reporting speed.
• Use automation to handle data errors quickly and maintain compliance with reporting requirements.

Governance and Quality

• Be a key contributor to the Data Governance Forum and Data Owners to monitor quality levels and create error reports.
• Technically enforce "Golden Records" to ensure consistent numbers in all company reports.
• Ensure system data follows the agreed definitions in the Global Data Dictionary.

Innovation Support

• Build the technical foundation needed to test ethical AI and machine learning tools within the Data Lake.
• Prepare datasets for advanced analytics, including models that predict future trends.

• Proven professional experience in a data engineering or technical business intelligence role.
• Strong proficiency in SQL and/or Python for handling and automating data.
• Experience building data pipelines and working with APIs.
• Strong problem‑solving skills and attention to detail regarding data accuracy.
• Ability to explain technical work to people in non‑technical roles.

• Experience pulling and working with data from Salesforce.
• Familiarity with public sector, economic development or strategic reporting frameworks (e.g. GLA).
• Knowledge of ethical AI and how to prepare data for machine learning.

• 30 Days Annual Leave: Generous paid time off to rest, recharge, and enjoy life outside of work.
• Competitive Salary: We value your contributions and ensure you are rewarded accordingly.
• Learning & Development Opportunities: Continuous growth is at the heart of our culture, with ample…