Mid​/Senior Data Engineer; Analytics

Salary: £40k - £80k

Methods Analytics (MA) is recruiting for a Data Engineer to join our team a permanent basis.

This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.

• Lead technical aspects of data engineering projects, providing direction and mentorship to junior and mid-level engineers
• Design and architect modern data solutions that align with business objectives and technical requirements
• Design and implement advanced ETL/ELT pipelines
• Build highly scalable and performant data solutions leveraging cloud platforms and open-source software
• Develop data models to handle enterprise-level analytical needs
• Make critical technical decisions on tools, frameworks, and approaches for complex data challenges
• Optimise large-scale data processing systems for performance and cost-efficiency
• Implement robust data quality frameworks and monitoring solutions
• Evaluate new technologies to enhance our data engineering capabilities
• Collaborate with stakeholders to translate business requirements into technical specifications
• Present technical solutions to leadership and non-technical stakeholders
• Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice

• Enable business leaders to make informed decisions with confidence through timely, accurate data insights
• Drive adoption of modern data architectures and platforms
• Deliver seamless data solutions that enhance user experience
• Elevate the technical capabilities of the entire data engineering team
• Help cultivate a data-driven culture within the organisation
• Establish technical standards and patterns that ensure quality and maintainability

• Proven experience leading technical aspects of data projects
• Strong data architecture and modelling skills with the ability to design scalable data solutions
• Experience mentoring junior engineers and providing technical guidance
• Deep understanding of data warehouse design principles and methodologies
• Advanced knowledge of optimisation techniques for large-scale data processing
• Strong proficiency in SQL and Python for handling complex data problems
• Hands-on experience with Apache Spark (PySpark or Spark SQL)
• Experience with the Azure data stack
• Knowledge of workflow orchestration tools like Azure Data Factory or Apache Airflow
• Experience with containerisation technologies like Docker
• Proficiency in dimensional modelling techniques
• Experience with CI/CD pipelines for data solutions
• Experience implementing and advocating for test-driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks
• Strong communication skills for translating complex technical concepts
• Track record of successful project delivery in a technical leadership capacity

• Experience designing and implementing data mesh or data fabric architectures
• Knowledge of cost optimisation strategies for cloud data platforms
• Experience with data quality frameworks and implementation
• Understanding of data lineage and metadata management
• Experience with technical project management
• Experience with data visualisation tools like Power BI or Apache Superset
• Experience with other cloud data platforms like AWS, GCP or Oracle
• Experience with modern unified data platforms like Databricks or Microsoft Fabric
• Experience with Kubernetes for container orchestration
• Understanding of streaming technologies (Apache Kafka, event-based architectures)
• Software engineering background with SOLID principles understanding
• Experience with high-performance, large-scale data systems
• Knowledge of recent innovations in AI/ML and GenAI
• Defence/Public Sector consultant experience

UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process. Some roles/projects may require Developed Vetting (DV) clearance; while not mandatory, a willingness to…