Senior Data Engineer

Salary: £60,000 - 65,000 per year

• We require a minimum BSc/BA in Computer Science or a related field, plus other professional management training.
• We need extensive experience of 5+ years in at least 3 of the following:
  Azure SQL Server 2022, Azure Data Factory (ADF), Microsoft Fabric, ETL/ELT workflows, and Synapse.
• We need architectural experience in Azure data warehousing; experience with No
  
  SQL technologies such as Cosmos DB or MongoDB is a bonus.
• We require advanced SQL CI/CD automation using Azure Dev Ops for deployments.
• We require proficiency in GIT for repository management, branching strategies, and collaboration.
• We need strong Python scripting skills for data automation, orchestration, and pipeline optimisation.
• Working knowledge of C# for maintaining and modifying legacy Windows applications is required.
• Experience with Power BI, Quick Sight, or similar analytics tools is required.
• We expect adherence to ETL and data management best practices, including incremental loads, error handling, and metadata logging.
• We require knowledge of data protection regulations such as GDPR and CCPA, as well as security protocols including encryption and RBAC.
• We require Agile/SCRUM experience, including offshore team collaboration.
• We need the ability to migrate legacy systems to modern cloud architectures.
• We expect clean, reusable code, the ability to anticipate issues, and pragmatic problem-solving.
• We need strong communication skills with stakeholders at all levels, from engineers to non-technical leaders.
• You must be able to manage tight deadlines with strong attention to detail.
• Ideally, you will also have experience with Entity-Relationship and multidimensional data modelling, including star and snowflake schemas, data warehouse life cycle, and SQL Server.
• Experience creating master and child packages, package configurations, logging, variables, and expressions would be advantageous.
• Experience working with offshore teams, writing technical specifications, and development in C# with good software methodology is desirable.
• Experience with Informatica, Talend, Azure SQL Server, and No
  
  SQL databases such as MongoDB or DynamoDB is helpful but not essential.

• We are responsible for developing and maintaining our existing cloud-based data platform.
• We analyse proposed information requests and work with business units to drive enterprise reporting.
• We write scripts for importing and exporting data into enterprise applications while maintaining data integrity.
• We use enterprise report-writing tools to extract data and support automated reporting in line with regulatory guidelines.
• We strive to meet corporate goals and identify opportunities to use technology to help achieve them.
• We select the best technology solutions for business problems.
• We ensure high data quality in all delivered solutions.
• We provide clear documentation for all design and coding projects.
• We maintain confidentiality of information processed, stored, or accessed by end users.
• We ensure our data architecture is scalable and maintainable.
• We design, implement, and expand data acquisition through extraction, transformation, and loading activities.
• We build, debug, monitor, and troubleshoot databases and ETL processes to ensure performance, reliability, and integrity.
• We design, develop, and maintain data stores such as data warehouses, data marts, and related repositories to support reporting, analytics, and integrations.
• We translate business needs into technical BI specifications.
• We design, implement, monitor, and maintain BI environments and database servers to meet usage and performance demands.
• We establish performance and reliability metrics for data stores, reports, dashboards, and analytics tools.
• We design, implement, and tune relational queries, stored procedures, and table-valued functions for optimal performance and reliability.
• We create and maintain supporting documentation such as data dictionaries, data flows, and database schemas.
• We collaborate with developers, product owners, and business analysts to design and develop new database applications, modules, and enhancements.
• We assist with the design and development of…