Data Engineer

Job Type: Full-Time 40 hours per week, Monday to Friday.

At Airband, we’re building more than broadband networks, we’re helping reshape connectivity across the UK. Originally established to tackle the digital divide in rural and underserved communities, Airband has grown into a dynamic broadband provider delivering services through Fibre, Fixed Wireless Access (FWA) and wholesale network partnerships.

We are looking for a skilled and motivated Mid-Level Data Engineer to design, build, and maintain reliable, efficient, and scalable data platforms and pipelines. You will play a key role in supporting analytics and business intelligence by ensuring high-quality data ingestion, transformation, and availability, primarily within an Azure Databricks environment.

Working closely with the Data and Reporting Manager, Data Analysts, wider IT teams, and external stakeholders, you will help maintain a robust, secure, and cost‑efficient data platform while contributing to continuous improvement and innovation.

• Design, develop, and maintain ETL and ELT pipelines.
• Write efficient, maintainable Python code using industry‑standard libraries, PySpark, and Spark.
• Build and manage data ingestion integrations, including APIs and Databricks Lakeflow Connect.
• Manage pipelines end to end: setup, monitoring, troubleshooting, optimisation, and issue resolution.
• Perform data cleansing, transformation, and validation to ensure high data quality.
• Design and implement efficient data models, schemas, and storage solutions.
• Guide the Data Analysts in creating performant SQL queries, views, and materialised views with efficient use of memory and compute.
• Present data in analytics‑ready formats to support reporting and advanced analysis.
• Manage data post‑ingestion, including documentation, archiving, retention, and deletion policies.

• Lead and contribute to Databricks (Azure) platform administration and engineering best practices.
• Monitor and optimise the performance of pipelines, tasks, and databases to ensure cost‑effective use of compute and storage.
• Implement monitoring, alerting, and regular checks for pipelines and databases.
• Support system updates, tooling upgrades, and ongoing platform improvements.

• Work with systems, IT, and architecture teams on system and data connectivity, extraction, security, and governance.
• Implement and maintain appropriate security measures and access controls.
• Support compliance with data governance and data management standards.
• Collaborate closely with Data Analysts, guiding and mentoring them to support their technical growth.
• Produce clear, accurate documentation for pipelines, datasets, integrations, and platform usage.
• Support the Manager in team development, process improvement, and platform planning.
• Provide data expertise for business‑wide projects as they are planned and delivered.
• Maintain awareness of new Databricks features, Azure services, and best practices to maximise efficiency and capability.
• Demonstrate a strong interest in AI and emerging data technologies, exploring practical applications within and beyond Databricks.
• Apply critical thinking, analytical reasoning, and innovative problem‑solving to overcome technical challenges.

• Effective time management and prioritisation
• Strong problem-solving skills
• Attention to detail and accuracy
• Ability to work independently and collaboratively as part of a wider Airband team
• Embraces change, is adaptable and is willing to learn
• Customer / user-focused mindset
• Planning and organisational skills
• Competent use of Microsoft 365 tools
• Emotional intelligence and professionalism
• Analytical and critical thinker with strong problem‑solving skills.
• Collaborative, supportive team player with a willingness to mentor others.
• Proactive and committed to continuous learning and improvement.

• Ability to learn new systems and technologies quickly
• Data handling and analysis skills
• Understanding of digital ways of working and collaboration tools
• Proficiency with Databricks

• SQL proficiency, programming skills (Python),…