Senior Data Engineer

Job Type

Full-Time – 40 hours per week, Monday to Friday.

At Airband, we’re building more than broadband networks; we’re helping reshape connectivity across the UK. Originally established to tackle the digital divide in rural and underserved communities, Airband has grown into a dynamic broadband provider delivering services through Fibre, Fixed Wireless Access (FWA) and wholesale network partnerships.

The Senior Data Engineer is responsible for designing, building, and maintaining scalable data platforms and pipelines that enable reliable analytics, reporting, machine learning, and operational decision‑making. This role combines strong software engineering skills with deep expertise in data architecture, cloud infrastructure, and data governance.

The role will work closely with data analysts, systems, IT, and architecture teams on system and data connectivity, extraction, security, and governance.

• Design, develop, and maintain ETL and ELT pipelines.
• Write efficient, maintainable Python code using industry‑standard libraries, PySpark, and Spark.
• Build and manage data ingestion integrations, including APIs and Databricks Lakeflow Connect.
• Manage pipelines end‑to‑end: set up, monitor, troubleshoot, optimise, and resolve issues.
• Perform data cleansing, transformation, and validation to ensure high data quality.
• Guide data analysts in creating performant SQL queries, views, and materialised views with efficient use of memory and compute.
• Present data in analytics‑ready formats to support reporting and advanced analysis.
• Lead and contribute to Databricks (Azure) platform administration and engineering best practices.
• Monitor and optimise the performance of pipelines, tasks, and databases to ensure cost‑effective use of compute and storage.
• Support system updates, tooling upgrades, and ongoing platform improvements.
• Work with systems, IT, and architecture teams on system and data connectivity, extraction, security, and governance.
• Implement and maintain appropriate security measures and access controls.
• Support compliance with data governance and data management standards.
• Collaborate closely with data analysts, guiding and mentoring them to support their technical growth.
• Support the manager in team development, process improvement, and platform planning.
• Provide data expertise for business‑wide projects as they are planned and delivered.
• Maintain awareness of new Databricks features, Azure services, and best practices to maximise efficiency and capability.
• Demonstrate a strong interest in AI and emerging data technologies, exploring practical applications within and beyond Databricks.
• Apply critical thinking, analytical reasoning, and innovative problem‑solving to overcome technical challenges.

• Effective time management and prioritisation.
• Strong problem‑solving skill.
• Attention to detail and accuracy.
• Ability to work independently and collaboratively as part of a wider team.
• Embraces change, is adaptable and is willing to learn.
• Customer / user‑focused mindset.
• Planning and organisational skills.
• Competent use of Microsoft 365 tools.
• Emotional intelligence and professionalism.

• Ability to learn new systems and technologies quickly.
• Data handling and analysis skills.
• Understanding of digital ways of working and collaboration tools.
• Solid experience with Spark and PySpark for distributed data processing.
• Hands‑on experience with Databricks on Azure, including platform usage and administration.
• Experience integrating data via REST APIs and working with databases such as Postgres.
• Experience of automation.
• Good understanding of data and systems architecture, including connectivity and integration.
• Knowledge of operating systems and Azure infrastructure.

• Knowledge of operating systems and Azure infrastructure.
• Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related technical field.
• Proven experience of Python.
• Hands‑on experience with Databricks on Azure, including platform usage and administration.
• Experience working in fast‑paced environment.
• Circa 5+ years of…