Data Engineer; NL

BBD is an international custom software solutions company that solves real-world problems with innovative solutions and modern technology stacks. With extensive experience across various sectors and a wide array of technologies, BBD’s core services encompass digital enablement, software engineering and solutions support, which includes cloud engineering, data science, product design and managed services.

Over the past 40 years, we have built a reputation for hiring the best talent and collaborating with client teams to deliver exceptional value through software. As the company has grown, this unwavering commitment to quality and continuous innovation has ensured clients get the full benefit from software that meets their unique environment.

BBD’s culture is one that encourages collaboration, innovation and inclusion. Our relaxed yet professional work environment extends into a flat management structure. At BBD, you are not just a number, but a valuable member of the team, working with like-minded, passionate individuals on challenging projects in interesting spaces. We deeply believe in the importance of each individual taking control of their career growth, with the support, encouragement and guidance of the company.

We do this for every BBDer, creating the space and opportunity to continue learning, growing and expanding their skillsets. We also proudly support and ensure diverse project teams as varied perspectives will always make for stronger solutions.

With hubs in 7 cities, we have mastered distributed development and support a flexible, hybrid working environment. Our hubs are also a great place to get to know people, share knowledge, and enjoy snacks, great coffee and catered lunches as well as social, sport and cultural gatherings.

Lastly, recognition is deeply ingrained in the BBD culture and we use every appropriate opportunity to show this through our Awards Nominations, shoutouts and of the course the exceptional bonuses that come from exceptional performance.

BBD is looking for a skilled Data Engineer to design, build and maintain scalable data pipelines and architectures. You will play a pivotal role in enabling data-driven decision‑making by ensuring our data infrastructure is robust, secure and efficient. You will work with modern tools and cloud platforms (AWS, Azure, Databricks) to transform raw data into actionable insights, supporting both traditional analytics and emerging AI/ML workloads.

• Pipeline development:
  Design, build and maintain efficient, reliable and scalable ETL/ELT pipelines using Python, SQL, and Spark
• Architecture & modelling:
  Implement modern data architectures (e.g., Data Lakehouse, Medallion Architecture) and data models to support business reporting and advanced analytics
• Cloud infrastructure:
  Manage and optimise cloud‑based data infrastructure on AWS and Azure, ensuring cost‑effectiveness and performance
• Data governance:
  Implement data governance, security and quality standards (e.g., using Great Expectations, Unity Catalog) to ensure data integrity and compliance
• Collaboration:
  
  Work closely with Data Scientists, AI Engineers and Business Analysts to understand data requirements and deliver high‑quality datasets
• MLOps support:
  Collaborate on MLOps practices, supporting model deployment and monitoring through robust data foundations
• Continuous improvement:
  Monitor pipeline performance, troubleshoot issues, and drive automation using CI/CD practices

• A minimum of 5 years of professional experience, with at least 2 years of experience with Databricks

• Programming & scripting:
  Strong proficiency in Python for data manipulation and scripting. Experience with Scala or Java is a plus
• Big Data processing:
  Extensive experience with Apache Spark (PySpark) for batch and streaming data processing
• Workflow orchestration:
  Proficiency with Apache Airflow or similar tools (e.g., Prefect, Dagster, Azure Data Factory) for scheduling and managing complex workflows
• Data warehousing:
  Proficiency in modern cloud data warehouses such as Snowflake, including designing, modelling and optimising analytical data structures to support…