Senior Consultant, Data Engineer, AI, UKI

Data Engineer Senior Consultant – Job Specification

Location:

Belfast or Derry/Londonderry Position Overview

We are seeking a highly skilled Data Engineer Senior Consultant with hands-on experience designing, building, and optimizing data solutions that enable advanced analytics and AI-driven business transformation. This role requires expertise in modern data engineering practices, cloud platforms, and the ability to deliver robust, scalable data pipelines for diverse business domains such as finance, supply chain, energy, and commercial operations.

• Design, develop, and deploy end-to-end data pipelines for complex business problems, supporting analytics, modernising data infrastructure and AI/ML initiatives.
• Design and implement data models, ETL/ELT workflows, and data integration solutions across structured and unstructured sources
• Collaborate with AI engineers, data scientists, and business analysts to deliver integrated solutions that unlock business value.
• Ensure data quality, integrity, and governance throughout the data lifecycle.
• Optimize data storage, retrieval, and processing for performance and scalability on cloud platforms (Azure, AWS, GCP, Databricks, Snowflake).
• Translate business requirements into technical data engineering solutions, including architecture decisions and technology selection.
• Contribute to proposals, technical assessments, and internal knowledge sharing.
• Data preparation, feature engineering, and MLOps activities to collaborate with AI engineers, data scientists, and business analysts to deliver integrated solutions

• Degree or equivalent certification in Computer Science, Data Engineering, Information Systems, Mathematics, or related quantitative field.

• Experience building and maintaining data pipelines using platforms such as Databricks, Azure Data Factory, Snowflake, or similar
• Good programming skills in Python and SQL, with familiarity with data engineering libraries (, pandas, PySpark, dbt)
• Solid understanding of data modelling, ETL/ELT processes, and Lakehouse concepts
• Experience with data quality frameworks, data governance, and compliance requirements.
• Familiarity with version control (Git), CI/CD pipelines, and workflow orchestration tools (Airflow, Prefect).

• Strong analytical and problem-solving mindset with attention to detail.
• Good team player with effective communication and storytelling with data and insights.
• Consulting skills, including development of presentation decks and client-facing documentation.

• Experience with real-time data processing (Kafka, Kinesis, Azure Event Hub).
• Knowledge of big data storage solutions (Delta Lake, Parquet, Avro).
• Experience with data visualization tools (Power BI, Tableau, Looker).
• Understanding of AI/ML concepts and collaboration with AI teams.

• Certifications such as:
• Databricks Certified Data Engineer Professional
• Azure Data Engineer Associate
• AWS Certified Data Analytics – Specialty
• Snow Pro Advanced:
  Data Engineer