Data Engineer

As a Data Engineer, you will be the architect and owner of our crucial data pipelines. You play a central role in our ambition to process billions of records daily and elevate our data infrastructure. You are responsible for the entire process: from data ingestion to delivering final insights.

• Design & Build:
  Design, build, and deploy new end-to-end data pipelines from scratch to integrate diverse and high-volume data sources.
• Massive Processing:
  Write efficient and scalable processing logic using (Py)
  Spark (in AWS Glue) to process, clean, and transform billions of records daily.
• Infrastructure as Code (IaC):
  Manage and define the entire data infrastructure (AWS Glue jobs, S3 buckets, Lambda functions) as code using Terraform. This forms the core of your "ownership."
• Quality & Performance:
  Be responsible for the quality, monitoring, and performance of the pipelines you build, ensuring data lands accurately and on time in our Data Lakehouse.
• Data Democratization:
  Actively assist in onboarding new data sources, ensuring your work directly leads to more insights and tangible value across the organization.

• Proven experience in Python.
• Hands‑on experience with AWS Glue.
• Solid understanding of the AWS data ecosystem (S3, IAM, Lambda's, Cloud Watch).
• Proven experience with Infrastructure as Code (IaC) is mandatory, preferably Terraform.
• Proficiency in using (Py)
  Spark for large-scale data processing.

• Experience with Snowflake.
• Experience with Hudi (or similar technologies for data lake transactions).

• A competitive market salary between € 3,500 and € 5,500 gross per month (based on 40 hours), depending on your experience and seniority level.
• Extensive opportunities for personal and professional development and training.
• The necessary support and resources to perform your job optimally.
• A workplace with driven professionals where there is also room for fun and relaxation.