Senior Fabric Engineer

Methods Analytics (MA) is recruiting for Senior Fabric Engineer to join our team within the Public Sector Business unit on a permanent basis.

This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.

• Work closely with cross-functional teams, translating complex technical concepts into clear, accessible language for non-technical audiences and aligning data solutions with business needs.

• Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic decisions and drive business transformation.

• Utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, and PowerBI to build robust, scalable, and future-proof end-to-end data solutions.

• Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data from various sources to deliver clean, reliable data.

• Develop and maintain sophisticated data models, employing dimensional modelling techniques to support comprehensive data analysis and reporting.

• Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust.

• Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data queries for performance and cost-efficiency.

• Develop intuitive and visually compelling Power BI dashboards that provide actionable insights to stakeholders across the organisation.

• Monitor and tune solution performance, identifying opportunities for optimisation to enhance the reliability, speed, and functionality of data systems.

• Stay ahead of industry trends and advancements, continuously enhancing your skills and incorporating the latest Data Engineering tools, languages, and methodologies into your work.

• Enable business leaders to make informed decisions with confidence by providing them with timely, accurate, and actionable data insights.

• Be at the forefront of data innovation, driving the adoption and understanding of modern tooling, architectures, and platforms.

• Deliver seamless and intuitive data solutions that enhance the user experience, from real-time streaming data services to interactive dashboards.

• Play a key role in cultivating a data-driven culture within the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice

• Proficiency in SQL and Python:
  You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease.

• Understanding of Data Lakehouse Architecture:
  You have a strong grasp of the principles and implementation of Data Lakehouse architecture.

• Hands-On Experience with Spark-Based Solutions:
  You possess experience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or even on-premise Spark clusters, using PySpark or Spark SQL to manage and process large datasets.

• Expertise in Building ETL and ELT Pipelines:
  You are skilled in building robust ETL and ELT pipelines, mostly in Azure, utilizing Azure Data Factory and Spark-based solutions to ensure efficient data flow and transformation.

• Efficiency in Query Writing:
  You can craft and optimise queries to be both cost-effective and high-performing, ensuring fast and reliable data retrieval.

• Experience in Power BI Dashboard Development:
  You possess experience in creating insightful and interactive Power BI dashboards that drive business decisions.

• Proficiency in Dimensional Modelling:
  You are adept at applying dimensional modelling techniques, creating efficient and effective data models tailored to business needs.

• CI/CD Mindset:
  You naturally work within Continuous Integration and Continuous Deployment (CI/CD) environments, ensuring automated builds, deployments, and unit testing are integral parts of your development workflow.

• Business Requirements Translation:
  You have a knack for understanding business requirements and translating them into precise technical specifications that guide data solutions.

• Strong Communication
  
  Skills:
  
  Ability to effectively translate complex technical topics into clear, accessible language for non-technical audiences

• Continuous Learning and Development:
  Commitment to continuous learning and professional development,…