Data Engineer; Junior to Senior Levels

About the role

The Idox Geospatial Division has brought together four geospatial business units into a single combined entity to establish one of the largest geospatial businesses in the UK. The new division provides a compelling capability that covers the full geospatial lifecycle, from strategy and consultancy to powerful software and data as a service.

Geospatial data significantly underpins the division’s current and future revenues. Within the Division’s Data & Research Team, the Data Engineer role is responsible for designing, building and optimising our data pipelines and infrastructure, ensuring that the curation, delivery and value added use of our geospatial data catalogue is undertaken to a high quality.

Working with the 3 sub teams of Research & Innovation, Data Delivery and Data Management you will ensure we provide quality assured data products and services to our customers, maximising the potential for automation of our data pipelines, contributing to the development of new and existing data products and services and supporting our research and innovation projects.

Continuous improvement is key to our success and you will directly contribute to the enhancement of our systems and processes as well as the adoption of relevant standards.

You will contribute to our increased use and application of new technologies including Artificial Intelligence as we develop new data insight products and services as well as improve the automation of our pipelines and data collection systems.

In the role you will provide technical support, product development and testing, data management and support to our Products, Sales and Customer Operations teams. You will help to ensure our key service management commitments are fulfilled to high quality and performance standards as well as making sure that our technical documentation is well maintained.

The role provides a growth path from Junior to Senior levels.

You will be assigned to one of the three subteams, though expected to work flexibly and in collaboration.

For All Levels

• Design, develop and maintain ETL pipelines for data ingestion, transformation, publication and delivery
• Automate, develop and continuously improve data processing procedures and pipelines
• Use cloud-based data platforms, infrastructure and modern data engineering, data management and geospatial technologies
• Provide technical support, guidance and advice for other divisional teams, partners and customers
• Ensure compliance with our operating procedures, quality management processes and relevant industry standards
• Develop and perform structured quality assurance and testing for existing and new data products
• Prepare and maintain documentation for our operating procedures, systems and infrastructure
• Liaison with third party data suppliers and partners
• Ensure adherence to appropriate information security, governance and security protocols for geospatial data
• Keep up to date with industry changes, opportunities, professional learning and development
• Adherence to Idox Information Security policies and protocols.

Level Specific Responsibilities

• Assist in building and debugging data pipelines
• Learn and apply best practices in data management
• Write and optimise SQL queries and Python scripts
• Assist with research, innovation, data projects and data product development
• Support the delivery and supply of data to customers
• Work under guidance from mid-level and senior data engineers

Mid Level Data Engineer

• Develop and optimise sustainable data workflows
• Implement data governance, monitoring and automation solutions
• Contribute to research, innovation, data projects and data product development
• Improve system performance and process efficiency
• Conduct code and quality reviews
• Identify and monitor operational risk
• Mentor and guide junior data engineers
• Work with stakeholders to define data requirements and solutions
• Architect and lead the design and development of data platforms, processes and pipelines
• Lead key initiatives in data infrastructure
• Lead research, innovation, data projects and data product development
• Manage and mitigate operational risk
• Monitor and report on key performance indicators
• Lead and…