T07 Data Engineer

We are looking for a Data Engineer / Senior Data Engineer to contribute to the development of reliable, scalable and secure data solutions.

You will be involved in building and enhancing data pipelines, data processing platforms and data warehouse solutions that support business and analytics needs. Working closely with technical teams, data scientists and other stakeholders, you will help transform data from multiple sources into meaningful and usable information.

This is an opportunity for a data professional who enjoys working with large datasets, solving data challenges and building data solutions in a dynamic environment.

• Design, develop and maintain data pipelines, ETL processes and data processing solutions for structured and unstructured data.
• Develop and optimise data models, data warehouses and data integration solutions.
• Work with data scientists and other stakeholders to understand data requirements and support analytics and modelling initiatives.
• Handle data from different sources and processing requirements, including batch, real-time and near-real-time data.
• Monitor data pipelines and ensure that data solutions meet agreed performance, reliability and service requirements.
• Implement data quality checks and practices to improve the accuracy, consistency and reliability of data.
• Apply appropriate data security, governance and management practices when developing data solutions.
• Troubleshoot and optimise existing data pipelines and processing workflows.
• Prepare technical documentation relating to data models, pipelines and data processing solutions.
• Support data-related solution design, proposal activities and implementation initiatives when required.

• Degree in Computer Science, Information Technology, Data Engineering, Data Science or a related discipline.
• Experience data engineering, data integration, ETL development or related areas.
• Hands-on experience developing and optimising data pipelines, ETL processes and data platforms .
• Experience with ETL / data integration technologies such as Informatica, Talend or similar tools .
• Good understanding of SQL, relational databases and DBMS .
• Programming experience in Python .
• Knowledge of data structures, data transformation, metadata and workload/dependency management.
• Familiarity with Big Data technologies , such as Apache Spark, Hadoop or Hive.
• Experience working with data from multiple sources and formats is advantageous.
• Strong analytical and problem-solving skills, with the ability to work with different stakeholders.

• Experience with any of the following will be an advantage:
• Power BI / Data Visualisation
• PostgreSQL, SAP or other enterprise databases
• Flat files and unstructured data such as documents, images, audio or video
• Kubernetes
• Docker / Podman
• Microservices architecture
• Dev Sec Ops  practices
• Microsoft Access and Share Point

• Permanent employment opportunity
• Exposure to enterprise-level data engineering projects
• Opportunities to work with modern data technologies and platforms
• Collaborative environment with opportunities for professional growth
• Exposure to both technical delivery and solution development initiatives