Senior Data Engineering Consultant

Overview

We are Rotate. We help airlines and airports make better commercial and strategic decisions about air cargo and provide (strategy) consulting, world-leading market data and software products. We’re based in the Netherlands and founded by a core of former aviation strategy consultants in 2022. We have built a growing team of 35+ people consisting of strategy consultants, data scientists and software developers.

We  recently launched a new Rotate Data Services practice in which we  help our international clients with data strategy and technical implementation, providing them with capabilities to drive real lasting impact. We  looking for our first Senior Data Engineering Consultant to join the team and build the practice together!

• Innovate and advise on the latest technologies and standard methodologies in Data Engineering and be able to identify software solutions that can address hurdles in client organizations

• Act as a technical leader for resolving problems, with both technical and non-technical audiences

• Mentoring, coaching, and steering colleagues across technical challenges

• Ability to work alone and self-steer initiatives, influencing the community of developers

• Take ownership of project work and develop client relationships

• Be a confident self-starter! Independently plan, design, code, debug and test major features, ensuring issues are identified early and requirements are delivered

• Identify technical areas for improvement and create business cases for improvement

• Design, implement and manage data pipelines that ingest vast amounts of data from various sources

• Enhance end-to-end workflows with automation, CI/CD processes, proper orchestration and monitoring

• Curiosity – proven abilities to take initiative and be innovative

• An analytical mind with a problem-solving aptitude

• Independent thinker and desire to share knowledge across the development community

• BS/MS in Computer Science, or related field with 7+ years of software/data engineering experience

• In-depth understanding of data lake architectures and experience implementing, data mesh architecture a plus

• Experience working across cloud providers a plus (i.e., AWS, Azure, GCP)

• Experience in orchestration technologies (e.g., Airflow, AWS Step Functions)

• Excellent knowledge of programming languages (e.g., Python, Scala, SQL)

• Hands-on experience in application deployment (e.g., Docker, container registry, K8s, etc.)

• Hands-on experience with CI/CD tooling (e.g., Git Hub Actions, Gitlab CI/CD, Travis, etc)

• Technical expertise with data modeling and mining techniques

• Experience with in the Apache Hadoop Ecosystem (I.e., Kafka, Spark, Hive, etc.)

• Experience with data warehousing technologies (e.g., Snowflake, Big Query, Synapse)

• Experience managing and provisioning Infra-as-Code (i.e., Terraform, Ansible)

• Experience (and understand the importance of) implementing proper platform/pipeline logging and monitoring

• Experience with data governance initiatives and/or integrating data quality/data catalogue/MDM solutions a plus

• Proficiency with modern software development methodologies such as Agile, source control, project management and issue tracking with JIRA

• You are fluent in English, other languages beneficial

In additional to excellent compensation, we think you  be proud and motivated to build a career at Rotate because you will be able to:

• Build things that matter. Solve complex problems in a critical industry. Advise clients on their most strategic questions, or partner with airlines to co-develop data-driven SaaS products with the latest technology stack. Drive efficiency and sustainability in global supply chains.

• Write your own story. Feel like an entrepreneur within a well-funded company and established team. Help us build Rotate and share in our joint success. Partner with us to tailor your development and career ambition.

• Growth and Development: We're dedicated to ensuring our people have the skills, training, and support to develop and grow. We hold knowledge sharing sessions and bring in trainings to keep our people up to date with the latest technologies and best practices.

• Live…