Data Engineer; Fabric-Platforms

Location

Methods Sheffield, England, United Kingdom

Salary: £50k - £65k

• Work closely with cross-functional teams, translating complex technical concepts into clear, accessible language for non-technical audiences and aligning data solutions with business needs.
• Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic decisions and drive business transformation.
• Utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, and Power
  
  BI to build robust, scalable, and future-proof end-to-end data solutions.
• Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data from various sources to deliver clean, reliable data.
• Develop and maintain sophisticated data models, employing dimensional modelling techniques to support comprehensive data analysis and reporting.
• Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust.
• Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data queries for performance and cost-efficiency.
• Develop intuitive and visually compelling Power BI dashboards that provide actionable insights to stakeholders across the organisation.
• Monitor and tune solution performance, identifying opportunities for optimisation to enhance the reliability, speed, and functionality of data systems.
• Stay ahead of industry trends and advancements, continuously enhancing your skills and incorporating the latest Data Engineering tools, languages, and methodologies into your work.

• Enable business leaders to make informed decisions with confidence by providing them with timely, accurate, and actionable data insights.
• Be at the forefront of data innovation, driving the adoption and understanding of modern tooling, architectures, and platforms.
• Deliver seamless and intuitive data solutions that enhance the user experience, from real‑time streaming data services to interactive dashboards.
• Play a key role in cultivating a data‑driven culture within the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice.

This role will require you to have or be willing to go through Security Clearance. As part of the onboarding process candidates will be asked to complete a Baseline Personnel Security Standard; details of the evidence required to apply may be found on the government website  If you are unable to meet this and any associated criteria, then your employment may be delayed, or rejected.

Details of this will be discussed with you at interview.

• Proficiency in SQL and Python:
  You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease.
• Understanding of Data Lakehouse Architecture:
  You have a strong grasp of the principles and implementation of Data Lakehouse architecture.
• Hands‑On Experience with Spark‑Based Solutions:
  You possess experience with Spark‑based platforms like Azure Synapse, Databricks, Microsoft Fabric, or even on‑premise Spark clusters, using PySpark or Spark SQL to manage and process large datasets.
• Expertise in Building ETL and ELT Pipelines:
  You are skilled in building robust ETL and ELT pipelines, mostly in Azure, utilising Azure Data Factory and Spark‑based solutions to ensure efficient data flow and transformation.
• Efficiency in Query Writing:
  You can craft and optimise queries to be both cost‑effective and high‑performing, ensuring fast and reliable data retrieval.
• Experience in Power BI Dashboard Development:
  You possess experience in creating insightful and interactive Power BI dashboards that drive business decisions.
• Proficiency in Dimensional Modelling:
  You are adept at applying dimensional modelling techniques, creating efficient and effective data models tailored to business needs.
• CI/CD Mindset:
  You naturally work within Continuous…