Sr. Databricks Engineer

Job Title:

Sr. Databricks Engineer Job Description We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled. The global technology and services leader that powers the world’s best brands, today and into the future. We’re solution-focused, tech-powered, intelligence-fueled. With unique data and insights, deep industry expertise, and advanced technology solutions, we’re the intelligent transformation partner that powers a world that works, helping companies become refreshingly simple to work, interact, and transact with.

We shape new game-changing careers in over 70 countries, attracting the best talent. The Concentrix Technical Products and Services team is the driving force behind Concentrix’s transformation, data, and technology services. We integrate world-class digital engineering, creativity, and a deep understanding of human behavior to find and unlock value through tech-powered and intelligence-fueled experiences. We combine human-centered design, powerful data, and strong tech to accelerate transformation  will be surrounded by the best in the world providing market leading technology and insights to modernize and simplify the customer experience.

Within our professional services team, you will deliver strategic consulting, design, advisory services, market research, and contact center analytics that deliver insights to improve outcomes and value for our clients. Hence achieving our vision. Our game-changers around the world have devoted their careers to ensuring every relationship is exceptional. And we’re proud to be recognized with awards such as "World's Best Workplaces," “Best Companies for Career Growth,” and “Best Company Culture,” year after year.

Join us and be part of this journey towards greater opportunities and brighter futures.

Sr. Databricks Engineer

Remote in USA

Working hours in EST

Databricks Data Engineer Professional

The Senior Data Engineer is responsible for the end-to-end data lifecycle, including the analysis, design, and implementation of data solutions on the Databricks Data Intelligence Platform running on Microsoft Azure, AWS or GCP. The role leverages Databricks, Python, PySpark, and SQL to deliver data ingestion, transformation, modeling, and pipeline orchestration. As the senior engineer, this role leads solution design, sets engineering standards for how pipelines are built, governed, and deployed, and guides other data engineers.

• Design, develop, and maintain robust batch and streaming data pipelines for extracting, transforming, and loading (ETL/ELT) data from multiple sources into the Databricks lakehouse on Azure.
• Automate and streamline data ingestion using Auto Loader, Lakeflow Connect, and Azure services such as Azure Data Factory and Event Hubs.
• Build and manage pipelines with Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables), including data quality expectations and change data capture.
• Perform complex data manipulation and transformation using PySpark and Spark SQL, ensuring data is prepared for advanced analytics, reporting, and AI/ML use cases.
• Design and implement orchestration and scheduling of data workflows with Lakeflow Jobs (formerly Databricks Workflows) to ensure reliability and efficiency.
• Design and implement scalable data models within the lakehouse using medallion architecture (bronze/silver/gold) and dimensional modeling, including SCD Type 1 and Type 2.
• Implement data governance and security in Unity Catalog, including access controls, lineage, and row filters and column masks for sensitive data.
• Optimize performance and cost across Delta tables, Spark workloads, serverless and…