Azure Data Engineer Hybrid

Elevate your career as an Azure Data Engineer specializing in Data Lakes and Streaming at Cognizant in Mississauga. Design and build high-performance data platforms in a collaborative, hybrid work environment.
As a critical member of the data engineering team, you will be tasked with developing scalable Data Lake solutions for structured and unstructured data. Your expertise in Spark and Kafka will drive the creation of batch and real-time data pipelines, with a focus on event-driven architectures and Python-based automation.

Key Responsibilities:

• Design scalable Data Lake solutions across business domains

• Develop batch and real-time data pipelines using Spark and Kafka

• Implement high-throughput streaming solutions using event-driven architectures

• Create Python-based automation components for data workflows

• Optimize platform performance and scalability through best practices
Requirements:

• Hands-on experience with Apache Spark and Data Frames

• Proficiency in Python and/or Scala for automation

• Experience managing Data Lake architectures on cloud platforms

• Expertise with Kafka and streaming architectures

• Familiarity with CI/CD pipelines and Dev Ops practices
Contribute your data engineering skills and collaborate with diverse teams to drive data-driven solutions at Cognizant.
#J-18808-Ljbffr