Scala Spark Lead

Spark Scala Developer

We are seeking a highly skilled and motivated Spark Scala Developer to join our dynamic team. As a Spark Scala Developer, you will play a critical role in the design, development, deployment and optimization of data processing applications.

Key Responsibilities:

• Develop and maintain data processing applications using Spark and Scala.
• Collaborate with cross-functional teams to understand data requirements and design efficient solutions.
• Implement test-driven deployment practices to enhance the reliability of application.
• Deploy artifacts from lower to higher environment ensuring smooth transition.
• Troubleshoot and debug Spark performance issues to ensure optimal data processing.
• Work in an agile environment, contributing to sprint planning, development and delivering high quality solutions on time.
• Provide essential support for production batches, addressing issues and providing fix to meet critical business needs.

Skills/

Competencies:

• Strong knowledge of Scala programming language
• Proficiency in Spark, including the development and optimization of Spark applications.
• Ability to troubleshoot and debug performance issues in Spark.
• Understanding of design patterns and data structure for efficient data processing.

Good to have skills:

• Familiarity with database concepts and SQL
  * Java and Snowflake.
• Experience with test-driven deployment practices.
• Familiarity with Python.
• Knowledge of Databricks.
• Understanding of Dev Ops practices.