Data Integration Engineer

Data Integration Engineer – Permanent – Abingdon, Oxfordshire

Hybrid – 3 days on site 2 days remote

Data Integration Engineer required:

- 5+ years’ experience working with databases & related tools. Strong proficiency with data virtualisation platforms & tools such as Teiid or similar. Solid understanding of SQL, relational databases, & data modelling. AWS & or Azure) & cloud-native data services. Familiarity with RESTful APIs, JSON, XML, OData, & message queues (Kafka). ETL/ELT. APIs. Knowledge of data governance, security, & compliance best practices.

Understanding of data lifecycle management & SOC2 security standards. Familiarity with geoscience disciplines, geospatial data & GIS tools (e.g., ArcGIS, QGIS) is advantageous. Scripting & automation (e.g., Power Shell, Python, Java). Gitlab. Spotfire data visualization platform or alternative dashboard solutions. Agile

My client is seeking a skilled & proactive Data Integration Engineer to join their Technical Services team. Reporting to the Team Lead the Data Integration Engineer will be responsible for designing, building, & maintaining robust data pipelines & integration frameworks that connect diverse systems including LLMs & a proprietary Data Integration solution.

• Design & implement scalable data integration solutions using ETL/ELT tools & APIs
• Develop & maintain data pipelines that include Large Language Models (LLMs)
• Build solutions that include cloud & on-premises environments
• Collaborate with data architects, analysts, & business stakeholders to understand data requirements
• Integrate data from various sources including databases, SaaS platforms, APIs, & flat files
• Monitor & optimize data flows for performance, reliability, & cost-efficiency
• Ensure data quality, consistency, & governance across integrated systems
• Automate data workflows & support real-time data streaming
• Document integration processes & maintain technical specification