Databricks Engineer

Azure Databricks Engineer

Location:

Minneapolis, MN Full Time Mandatory

Skills:

Data Bricks - Data Engineering. Must Have:

• 5+ years of experience in the IT/Technology and having at least 3+ years of experience in Azure Databricks
• Hands on experience in development of Azure cloud DWH & datalakes using Azure technologies like Spark (Scala or Python), ADF, Azure Databricks, Terraform & CI/CD.
• Strong programming skills in Pyspark, Python, writing complex queries in Postgresql, T-SQL
• 6+ years of experience in coding complex U-SQL, Spark (Scala or Python). T-SQL, postgresql
• Should have experience in Azure Storages like ADLS Gen2, Azure Postgresql
• Design and develop automation to support continuous delivery and continuous integration process when it comes to cloud infrastructure.
• Work closely with the Development and Operations teams to build and maintain CI/CD pipelines to support automated deployment of infrastructure (Dev Ops) and Infrastructure as Code (IaC) using Terraform and Enterprise Github

Gathering of requirements-Assist in conducting workshops and discussions with client stakeholders to gather business process requirements. Coding and Configuration-Develop and deliver code for assigned modules, in alignment with client requirements ensuring proper integration with system components.