Senior Infrastructure Engineer - Database/ETL Infrastructure
Listed on 2026-11-07
-
IT/Tech
Cloud Computing: Infrastructure & Operations, Data Engineering, Azure
At Lumenalta, we partner with forward-thinking organizations to build technology solutions that scale, delight users, and accelerate business growth. Our global teams bring curiosity, commitment, and technical excellence to every project. We value transparency, autonomy, and impact, empowering every team member to do their best work.
About the RoleWe are looking for a Senior Infrastructure Engineer to support the database and ETL (extract, transform, load) infrastructure of an Azure environment for a client in a regulated banking domain. In this role you will operate and troubleshoot the Azure Data Factory (ADF) pipelines that move files into Snowflake, resolve file-movement and database-side issues, own monitoring and alerting for data workloads, and help keep the environment secure, reliable, and well documented.
The focus is on infrastructure and pipeline operations rather than data transformation.
- ADF operations. Monitor Azure Data Factory, read failed pipeline runs, and fix triggers, linked services, self-hosted integration runtimes, and expired or rotated credentials so data keeps moving.
- Snowflake administration. Operate the Snowflake side of ingestion: stages, file formats, warehouses, roles and permissions, COPY INTO failures, and stuck or expensive queries.
- File movement troubleshooting. Investigate and resolve ingestion failures such as bad file formats, missing or late files, expired credentials, misconfigured stages, and triggers that did not fire, and document the root cause and fix for each.
- Storage and transfer infrastructure. Manage the blob storage, SFTP endpoints, access keys and SAS tokens, and file arrival monitoring that feed the pipelines.
- Monitoring and alerting. Build alerting for pipeline failures, load failures, database health, and credential expiry with Azure Monitor and Log Analytics, so issues are caught before the business notices.
- Vulnerability remediation. Own scanner and penetration test findings on database servers, integration runtime hosts, and data services: apply patches, upgrade software, fix configurations, and track exceptions to closure.
- Network collaboration. Explain what data services need from the network (private endpoints, VNet integration, NSG rules, integration runtime connectivity) and work with networking teams to put it in place.
- Documentation. Write and maintain runbooks covering recovery steps, credential rotation procedures, and known failure patterns.
- 7+ years of experience in infrastructure or operations, with at least 3 years hands-on in Azure.
- Strong operational experience with Azure Data Factory: troubleshooting failed runs, triggers, linked services, integration runtimes, and credentials.
- Hands-on Snowflake administration in production: stages, file formats, warehouses, roles and permissions, and troubleshooting failed loads.
- Experience operating Azure storage and file transfer infrastructure (blob storage, SFTP, access keys, SAS tokens).
- An operational troubleshooting mindset: takes a failed overnight load from investigation to resolution and documents the cause.
- Experience setting up monitoring and alerting for production data pipelines.
- Experience owning vulnerability remediation on servers and data services, from finding to closure.
- Working knowledge of Azure networking, including VNets, private endpoints, and NSGs.
- Strong documentation habits, including writing and maintaining runbooks.
- A strong sense of ownership and the ability to work independently, taking problems from investigation to resolution.
- Advanced English and the ability to communicate technical issues clearly to engineers and client stakeholders in a distributed, remote team.
- Administration of Azure SQL Database, SQL Managed Instance, or SQL Server.
- Working experience with AKS, enough to debug workloads and service connectivity that feed or consume data.
- Experience operating Databricks, Azure Synapse, or Microsoft Fabric.
- Scripting in Power Shell, Python, or SQL for automation and troubleshooting.
- Experience running CI/CD pipelines (Azure Dev Ops Pipelines or Git Hub Actions) for ADF artifacts.
- Infrastructure as code with Terraform or Bicep.
- Experience in banking, financial services, or other regulated environments.
- Consulting or client-facing delivery experience.
- Certifications such as DP-300, DP-203, AZ-104, or Snow Pro Core.
At Lumenalta, you can expect that you will:
- Be 100% dedicated to one project at a time so that…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).