Senior Data Engineer

Job Summary:

We are seeking a Senior Data Engineer to design, develop, and deliver enterprise-scale big data solutions. This role requires strong hands-on experience with modern big data frameworks, cloud-native development on AWS, and the ability to provide technical leadership across design, development, and production support.

Key Responsibilities

• Lead end-to-end design and development of enterprise big data solutions.
• Design and build data pipelines using Spark, Scala, AWS Glue, and AWS Lambda.
• Develop scalable applications using Java, Scala, and/or Python.
• Design and optimize analytical SQL solutions on Amazon Redshift or Snowflake.
• Advise on architecture, system integration patterns, and technology decisions.
• Create and review technical design and integration documentation.
• Perform code reviews, enforce engineering standards, and mentor developers.
• Resolve complex defects and support performance testing and tuning.
• Provide production support, troubleshooting, and environment optimization.
• Collaborate with business stakeholders and support UAT activities.
• Participate actively in Agile/Scrum delivery and continuous improvement.

Required Qualifications

• 8–10+ years of overall IT experience with 5+ years in big data design and development.
• Strong hands-on experience with Spark, Scala, AWS Glue, AWS Lambda.
• Strong application development skills in Java, Scala, and/or Python.
• Advanced SQL experience; Redshift or Snowflake preferred.
• Experience leading technical design, code reviews, and mentoring teams.
• Strong problem-solving, communication, and documentation skills.

Preferred Qualifications

• Experience in Insurance or Investment Management domains.
• Experience supporting enterprise production environments.
• Exposure to performance optimization and large-scale data platforms.