More jobs:
Job Description & How to Apply Below
Responsibilities
Develop and maintain Azure Data Factory orchestrations with Databricks integrations
Configure and manage Unity Catalog for data governance and access control
Design and implement Delta Lake schemas and tables with appropriate security permissions
Load datasets from diverse sources into Databricks using ADF with Medallion architecture
Convert Databricks workspace from hive metastore to Unity Catalog and set up associated permissions
Build and optimize Delta Live Tables, ensuring performance and cost-efficiency
Develop deployment pipelines using Azure Dev Ops and Git Hub Enterprise for CI/CD processes
Deploy and manage Azure PaaS resources such as Azure SQL, Azure Data Lake, and Synapse
Collaborate with team members independently and provide technical leadership
Support a highly regulated environment with a focus on data security, governance, and compliance
Troubleshoot and resolve complex data platform issues efficiently
Desired Skill-Set
7+ years' experience with Azure Data Factory, Databricks, and Azure Functions (C#)
Deep knowledge of Python, notebooks, Spark, and pandas within Databricks
Expertise in Unity Catalog and data governance setup in a cloud environment
Experience loading datasets from various sources using ADF in a Medallion architecture
Proficiency in converting and managing Databricks workspace permissions and security
Familiarity with Delta Live Tables, cost, and performance optimization
Experience with Azure Dev Ops or Git Hub for Dev Ops pipelines and CI/CDWorking knowledge of Azure Entra SSO and RBAC configuration
Ability to work in a highly regulated industry environment with limited access
Strong communication skills and ability to lead small teams independently
Financial services industry experience is an asset
Nice to Have
Previous experience working with financial institutions
Beach Head is an equal opportunity agency and employer. We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×