AWS Data Lakehouse Engineer

Job description

Role-AWS Data Lakehouse Engineer

Mandatory Skills : AWS Lambda, Data lakehouse Architecture, ETL Concepts

Mode-5 days from Office

Type-Perm/FTE

Location-Basildon, UK

Salary- GBP 70k/Annum

We are seeking a talented and experienced

to join the Data Solutions domain in EMEA In this role you will design build

Data Lakehouse Engineer

and optimize scalable lakehouse and data platform solutions that enable data driven decision making across the organization You will collaborate

closely with cross functional teams to create resilient ingestion and transformation pipelines while ensuring reliability performance and high

quality data across the ecosystem

• Contribute to the design and implementation of lakehouse integration architectures including data flows process flows and ELTETL patterns
• Build optimize and maintain scalable data pipelines for ingestion processing and storage across data lake and lakehouse layers
• Implement and uphold data governance security lineage and compliance best practices throughout the data lifecycle
• Monitor troubleshoot and finetune data workflows compute jobs and storage layers to ensure high performance and reliability
• Provide production support ensuring robust system observability with proactive detection and resolution of issues
• Collaborate with platform analytics and engineering teams to ensure efficient data modeling table design and storage optimization eg
• Iceberg Delta patterns

• 7 years of experience in a data engineering or similar role within a fastpaced enterprisescale environment
• Bachelors or Masters degree in Computer Science Data Engineering or a related technical field
• Strong Proficiency in SQL and Data Integration Platforms such as IBM Streamsets or Informatica with thorough understanding of data
• transformation and orchestration processes
• Extensive Experience with AWS services including IAM Lambda EKS S3 Data Lake EMR PySpark MWAA and Lakehouse technologies
• Apache Iceberg
• Proven expertise with Snowflake including performance tuning and efficient query design
  
  Experience with batch pipelines eg
• Stream Sets and streaming technologies eg Kafka

• Data Transformation Frameworks such as DBT
• Experience with both batch Stream Sets and streaming Kafka data solutions
• Familiarity with data modelling concepts Inmon Kimball Data Vault etc
• Exposure to CICD or Infrastructureascode Terraform or any other is a plus
• Application Performance Monitoring Framework experience is a plus
• Knowledge of data quality and security best practices is advantageous
• Ability to understand complex architecture solutions and make sound estimates for the implementation

• Strong attention to detail with a proactive approach to identifying and resolving problems
• A genuine interest in emerging data technologies and a curiosity about continuous improvements
• Excellent verbal and written communication skills
• Attention to detail mindset proactively identify problems evaluate solutions
• Comfort working in an AIempowered automationdriven environment

Mandatory Skills : AWS Lambda, Data lakehouse Architecture, ETL Concepts

Good to Have Skills : DBT, Snowflake