Senior Azure Databricks Developer

We are actively seeking an experienced, high-caliber, and technical Senior Azure Databricks Developer with 8 to 10 years of professional experience to join our client engineering team in Charlotte, NC, USA on a full-time contract basis. In this critical data engineering role, you will be responsible for building robust cloud data pipelines, architecting scalable data processing solutions, and integrating advanced analytics workflows.

You will leverage your deep specialist expertise in Azure Databricks, PySpark, Python, Azure Data Factory, and Azure Data Lake to deliver uncompromised data integration, transformation, and reliability. This opportunity offers competitive compensation, executive technical visibility, and exceptional career growth prospects within a premier data-driven enterprise.

As a Senior Azure Databricks Developer supporting enterprise data engineering initiatives in Charlotte, NC, you will take full operational, tactical, and technical ownership of ETL pipeline design, big data processing, and cloud repository architecture. Your day-to-day responsibilities include developing optimized PySpark notebooks and Python scripts in Azure Databricks, orchestrating complex workflows using Azure Data Factory (ADF), managing data storage in Azure Data Lake, and maintaining relational integrity across Azure SQL, Azure Synapse Analytics, and MS SQL Server.

You will also participate in rigorous design and code reviews, ensure adherence to technical documentation standards, and collaborate closely with Agile project teams and business stakeholders in the insurance domain. Furthermore, you will manage application requirements via direct email to Najma Haseen at  or via Linked In direct messaging, ensuring strict compliance with 8-10 years of data engineering experience standards.

• Design, develop, test, and deploy scalable big data processing pipelines utilizing Azure Databricks, PySpark, and Python.
• Architect and orchestrate complex ETL/ELT workflows and data integration pipelines using Azure Data Factory (ADF) and Azure Data Lake.
• Manage and optimize relational data models, queries, and stored procedures across Azure SQL, Azure Synapse Analytics, and MS SQL Server.
• Lead comprehensive technical design reviews, peer code reviews, and maintain meticulous architectural documentation.
• Implement enterprise data governance, security protocols, and performance tuning for large-scale data lakehouse environments.
• Collaborate within Agile software development frameworks, participating in sprint planning, daily stand-ups, and backlog grooming via JIRA.
• Partner closely with insurance domain business stakeholders and data analysts to translate business requirements into technical data solutions.
• Ensure strict adherence to high-availability service level agreements (SLAs), data pipeline latency targets, and data quality standards.

• Bachelor's degree in Computer Science, Data Science, Information Technology, Software Engineering, or a related technical discipline.
• Minimum of 8 to 10 years of progressive professional experience in data engineering, software development, and cloud data warehousing.
• Strong hands-on operational proficiency with Azure Databricks, PySpark, and Python programming.
• Deep expertise in Azure Data Factory (ADF), Azure Data Lake storage generations, and cloud data ingestion patterns.
• Strong practical knowledge of Azure SQL, Azure Synapse Analytics, and MS SQL Server database administration.
• Excellent understanding of ETL/ELT concepts, data warehousing principles, and relational database management systems.
• Proven experience conducting design reviews, code reviews, and authoring comprehensive…