AWS Data Engineer Ext - Outside IR35

AWS Data Engineer
Rate: Up to £400 per day (Outside IR35)
Contract Length: 6 Months (with strong potential for extension)
Location: Hybrid - 1 day per week onsite in Central London

A leading organisation is seeking an experienced AWS Data Engineer to join their data and analytics team, contributing to the design, development and optimisation of large-scale data solutions within a modern cloud environment. This contract offers the opportunity to work on high-impact projects, delivering data platforms and pipelines that drive real-time insights and strategic business decisions.

Responsibilities for the AWS Data Engineer:

• Design, build and maintain scalable data pipelines and architectures within the AWS ecosystem
• Leverage services such as AWS Glue, Lambda, Redshift, EMR and S3 to support data ingestion, transformation and storage
• Work closely with data analysts, architects and business stakeholders to translate requirements into robust technical solutions
• Implement and optimise ETL/ELT processes, ensuring data integrity, consistency and quality across multiple sources
• Apply best practices in data modelling, version control, and CI/CD to deliver maintainable and reusable code
• Monitor data performance and reliability, proactively identifying opportunities to enhance efficiency and scalability
• Support the integration of data from diverse systems, including APIs and third-party platforms, into a unified architecture
• Ensure compliance with data governance, privacy and security policies throughout all stages of development
• Collaborate in an Agile environment, contributing to sprint planning, peer reviews and continuous improvement initiatives

Essential Skills for the AWS Data Engineer:

• Extensive hands-on experience with AWS data services
• Strong programming skills in Python (including libraries such as PySpark or Pandas)
• Solid understanding of data modelling, warehousing and architecture design within cloud environments
• Experience building and managing ETL/ELT workflows and data pipelines at scale
• Proficiency with SQL and working knowledge of relational and non-relational databases
• Experience deploying data infrastructure using IaC tools such as Terraform or Cloud Formation
• Understanding of Dev Ops and CI/CD pipelines for data engineering solutions
• Strong problem-solving skills, with an ability to work both independently and collaboratively within multi-disciplinary teams

Desirable Skills for the AWS Data Engineer:

• Experience with Databricks, Kafka, or Kinesis for real-time data streaming
• Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow
• Familiarity with machine learning model deployment pipelines or data lakehouse architectures

Data Engineer, AWS Data Engineer