Senior PySpark Developer

Position: Senior PySpark Developer Role
Take your career to the next level as a Senior PySpark Developer with Infosys in Mississauga, Ontario. Focus on designing and implementing high-performance data solutions for scalable architectures.

Infosys is on the lookout for a Senior PySpark Developer to work on cutting-edge data processing projects. This role will require you to leverage your extensive Spark and Scala knowledge while collaborating with engineers and business experts. You should have a strong track record in building efficient data pipelines and a keen understanding of big data technologies.

Key Responsibilities:

• Develop and optimize large-scale data processing systems using Spark

• Implement efficient batch and streaming workflows leveraging Kafka

• Create Spark applications for complex transformations and data modeling

• Maintain data lake solutions with the Hadoop ecosystem

• Collaborate with teams to ensure scalable solutions meet business needs

Requirements:

• 4+ years in IT with a focus on big data

• Strong experience in Apache Spark, Scala, and Py Spark

• Familiarity with data lakes, data warehouses, and ETL design

• Understanding of distributed systems and performance tuning

• Ability to translate business needs into technical solutions

Create lasting impact through your skills in data processing at Infosys.
#J-18808-Ljbffr