Senior Data Pipeline Engineer; Freelance

About the Role

Our analytics & ML pipelines are the heartbeat of this platform. Built in Python and Apache Spark, they run in Databricks work spaces.

We are looking for a Senior Data Pipeline Engineer freelancer (≥ 80 %, start as soon as possible) for 6 months (possible conversion into FTE) to support our team during a crunch time driven by customer demand.

Would you like to help us make the advertising industry ready for the 1st-party era? Then we’d love to hear from you!

• Own, Design, Build & Operate Data Pipelines – Take responsibility for our Spark-based pipeline, from development through production and monitoring
• Advance our ML Models – Improve and product ionise models for AdTech use‑cases such as lookalike modelling and demographics modeling
• AI‑Powered Productivity – Leverage LLM‑based code assistants, design generators, and test‑automation tools to move faster and raise the quality bar. Share your workflows with the team
• Drive Continuous Improvement – Profile, benchmark, and tune Spark workloads, introduce best practices in orchestration & observability, and keep our tech stack future‑proof

• (Must have) Expert-level Python and PySpark/Scala Spark experience
• (Plus) Rust proficiency (we use it for backend services and compute-heavy client-side modules)
• (Must have) Bachelor/Master/PhD in Computer Science, Data Engineering, or a related field and 5+ years of professional experience
• (Must have) Proven track record building resilient, production‑grade data pipelines with rigorous data‑quality and validation checks
• (Plus) Working knowledge of ML lifecycle and model serving; familiarity with techniques for audience segmentation or look‑a‑like modelling is a big plus
• (Must have) Data‑platform skills: operating Spark clusters, job schedulers, or orchestration frameworks (Airflow, Dagster, custom schedulers)