Data Engineer

Data Engineer – 12 Month Fixed-Term Contract

Division:
Data, Technology & Innovation

Department:
Digital Intelligence Solutions

• Salary: National (Edinburgh and Leeds) ranging from £52,400 to £71,200 and London from £57,700 to £78,300 (salary offered will be based on skills and experience)
• This role is graded as: Senior Associate - Regulatory
• Your recruitment contact is Sonika via S Applications must be submitted through our online portal. Applications sent via social media or email will not be accepted.

We regulate financial services firms in the UK, to keep financial markets fair, thriving and effective. By joining us, you’ll play a key part in protecting consumers, driving economic growth and shaping the future of UK finance services.

The Data, Technology and Innovation (DTI) division enables the FCA to be a digital-first, data-led smart regulator by delivering a secure, agile and cost-effective technology and data ecosystem that drives better decisions, transparency and operational efficiency. Sitting within DTI, the Digital Intelligence Solutions team deliver a Digital Unified Intelligence Environment to surface insights for action through tools, dashboards and bespoke analysis.

• Provide hands‑on technical leadership, guiding the team to build and support solutions that are robust, scalable and fit for purpose within an AWS Cloud environment
• Advise on technical design and architecture for data platforms, ensuring solutions meet business needs and adhere to FCA engineering standards
• Review and assure quality of deliverables from internal and external teams, embedding best practices like CI/CD, automated testing (Test-Driven Development/ Behaviour-Driven Development) and code quality standards
• Identify opportunities for product enhancements and quick wins, influencing design proposals that deliver measurable business benefits
• Opportunity to work closely with senior professionals, diverse stakeholders and third‑party suppliers to deliver technology change that makes FCA a data‑focus, tech‑enabled regulator
• Foster a culture of agility and continuous improvement, enabling faster time-to-market, predictable releases and optimised delivery through modern engineering practices

Minimum:

• Experience in building and delivering robust data platforms and systems within Agile and Dev Ops environments, leveraging AWS Cloud to create scalable, secure and high‑performing solutions
• Prior experience applying modern engineering practices such as CI/CD, Lean Architecture, automated testing (Test-Driven Development/ Behaviour-Driven Development), branching strategies and continuous monitoring to ensure quality and efficiency
• Experience working with technologies like Cloudera, Talend ETL, Python and PySpark, while collaborating with stakeholders and third‑party suppliers to deliver impactful, end‑to‑end data solutions

Essential:

• Proven expertise in designing and optimising data pipelines and ETL workflows that transform data into actionable insights
• Deep knowledge of big data technologies and strong understanding of data governance, security and compliance principles
• Ability to collaborate seamlessly with cross‑functional teams and manage complex integrations across diverse environments
• Passion for innovation and continuous improvement with a focus on enhancing performance and reliability in data engineering

• 25 days annual leave plus bank holidays
• Hybrid model where employees work a minimum of 40% in the office each month (expectation of 50% for senior leaders). Changing from September toa minimum of 50% in the office each month (expectation of 60% for Directors and Executive Directors)
• Non‑contributory pension (8–12% depending on age) and life assurance at eight times your salary
• Private healthcare with Bupa, income protection and 24/7 Employee Assistance
• 35 hours of paid volunteering annually
• A flexible benefits scheme designed around your lifestyle

Our colleagues are the key to our success as a regulator. We are committed to fostering a diverse and inclusive culture: one that’s free from discrimination and bias, celebrates difference and supports…