Data Engineer; Fabric-Platforms

Methods Analytics (MA) is recruiting for aData Engineer to join our team within the Public Sector Business unit on a permanent basis.

This role will be mainly remotebut require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.

Salary : £50k - £65k

• Work closely with cross-functional teams, translating complex technical concepts into clear, accessible language for non-technical audiences and aligning data solutions with business needs.
• Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic decisions and drive business transformation.
• Utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, and Power
  
  BI to build robust, scalable, and future-proof end-to-end data solutions.
• Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data from various sources to deliver clean, reliable data.
• Develop and maintain sophisticated data models, employing dimensional modelling techniques to support comprehensive data analysis and reporting.
• Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust.
• Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data queries for performance and cost-efficiency.
• Develop intuitive and visually compelling Power BI dashboards that provide actionable insights to stakeholders across the organisation.
• Monitor and tune solution performance, identifying opportunities for optimisation to enhance the reliability, speed, and functionality of data systems.
• Stay ahead of industry trends and advancements, continuously enhancing your skills and incorporating the latest Data Engineering tools, languages, and methodologies into your work.

• Enable business leaders to make informed decisions with confidence by providing them with timely, accurate, and actionable data insights.
• Be at the forefront of data innovation, driving the adoption and understanding of modern tooling, architectures, and platforms.
• Deliver seamless and intuitive data solutions that enhance the user experience, from real-time streaming data services to interactive dashboards.
• Play a key role in cultivating a data-driven culture within the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice

Requirements

• Proficiency in SQL and Python:
  You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease.
• Understanding of Data Lakehouse Architecture:
  You have a strong grasp of the principles and implementation of Data Lakehouse architecture.
• Hands-On Experience with Spark-Based Solutions:
  You possess experience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or even on-premise Spark clusters, using PySpark or Spark SQL to manage and process large datasets.
• Expertise in Building ETL and ELT Pipelines:
  You are skilled in building robust ETL and ELT pipelines, mostly in Azure, utilising Azure Data Factory and Spark-based solutions to ensure efficient data flow and transformation.
• Efficiency in Query Writing:
  You can craft and optimise queries to be both cost-effective and high-performing, ensuring fast and reliable data retrieval.
• Experience in Power BI Dashboard Development:
  You possess experience in creating insightful and interactive Power BI dashboards that drive business decisions.
• Proficiency in Dimensional Modelling:
  You are adept at applying dimensional modelling techniques, creating efficient and effective data models tailored to business needs.
• CI / CD Mindset:
  You naturally work within Continuous Integration and Continuous Deployment (CI / CD) environments, ensuring automated builds, deployments, and unit testing are integral parts of your development workflow.
• Business Requirements Translation:
  You have a knack for understanding…