Data Migration Engineer

We are seeking a detail‑oriented and capable Data Migration Engineer to join our Data & AI practice. The successful candidate will bring solid experience in data migration, ETL/ELT pipeline development, and cloud‑based data platforms, with a focus on AWS Data Lakehouse environments.

This role is key to supporting the design, build, and validation of data migration pipelines, enabling the successful transition of data from legacy systems to modern cloud platforms. You will contribute to ensuring data quality, integrity, and performance, particularly through structured testing and validation activities.

You will work closely with architects, senior engineers, and analysts to deliver scalable and reliable migration solutions, using technologies such as AWS Glue, Apache Iceberg, Python/PySpark, SQL, and YAML configurations. You should be comfortable working in a collaborative, delivery‑focused environment and have a strong interest in data migration, cloud technologies, and modern data engineering practices.

• Support delivery within data migration programmes, contributing to key work streams
• Collaborate with architects, engineers, and stakeholders to implement migration solutions
• Assist in planning and executing data migration tasks and deliverables

• Build and maintain data migration pipelines from legacy data warehouses to AWS‑based platforms
• AWS Glue
• Python / Py Spark
• SQL
• YAML configurations
• Support execution of bulk data migrations and incremental/delta loads
• Assist with pipeline repointing and migration to cloud environments

• Test ETL/ELT data pipelines on AWS services, including AWS Glue and Apache Iceberg
• Support validation of data pipeline migrations to AWS Data Lakehouse architectures
• Python/PySpark transformations
• SQL‑based validation logic
• YAML‑driven configurations
• Execute and validate:
• Initial bulk data loads
• Write and run SQL queries to validate:
• Transformation outputs
• Support development of test scripts and validation checks

• Work with AWS services including:
• AWS Glue
• S3‑based data lakes
• Support implementation of Data Lakehouse architectures, including Apache Iceberg
• Contribute to improving pipeline performance and reliability

• Apply transformation logic based on defined data mapping rules
• Support preparation of data for target‑state models
• Assist in ensuring consistency between source and target datasets
• Work collaboratively with:
• Solution Architects
• Data Migration Architects
• Analysts and QA teams
• Follow established engineering standards and best practices
• Contribute to documentation and reusable components

• Support maintenance of data quality and integrity during migration
• Follow secure data handling practices
• Assist with compliance requirements, including:
• GDPR
• Public sector data standards (where applicable)
• Contribute to testing, validation, and audit activities

• Strong focus on testing, validation, and data quality assurance
• Ability to work across data pipelines and transformation workflows
• Good analytical and problem‑solving skills
• Effective communication and teamwork skills
• Willingness to learn and develop in data migration and cloud technologies

• Hands‑on experience with:
• AWS cloud services, especially AWS Glue
• Python / Py Spark
• SQL querying and validation
• Experience testing or supporting:
• Familiarity with:
• Data lake / Lakehouse concepts (e.g., Apache Iceberg)
• Distributed processing frameworks (e.g., Spark)
• Basic understanding of:
• ETL vs ELT approaches
• Cloud‑based data architectures
• Exposure to version control and CI/CD tools desirable

We offer a range of tailored benefits that support your physical, emotional, and financial wellbeing. Our Learning and Development team ensures continuous growth and development opportunities for our people. We also offer flexible work options.

We are an equal opportunities employer. We believe in the fair treatment of all our employees and commit to promoting equity and diversity in our employment practices.

We are also a proud Disability Confident Committed Employer – we are committed to creating a diverse and inclusive workforce. We actively collaborate with individuals who have disabilities and long‑term health conditions that affect their ability to perform normal daily activities, ensuring barriers are eliminated when it comes to employment opportunities. In line with our commitment, we guarantee an interview to applicants who declare to us, during the application process, that they have a disability and meet the minimum requirements for the role.

If you require any reasonable adjustments during the recruitment process, please let us know. Join us in building a truly diverse and empowered team.