Senior Hadoop developer

Overview

Primary Skill:
Hadoop, spark, python, Hive, Imapala

Secondary: SQL, ML

Experience:
Minimum 10+ years

We are seeking a highly skilled and experienced Senior Hadoop Developer to join our team. The ideal candidate will have a strong background in Pyspark, Hadoop, and SQL. Work experience in Machine learning project is a plus.

• Technically Strong in Pyspark, Hadoop and SQL.
• Design, develop, and maintaining scalable and secure software solutions.
• Collaborate with ML teams on feature engineering, data preprocessing, and optimizing data formats for model training.
• Optimize performance for large-scale distributed data processing and ML workloads.
• Collaborate with data scientists, ML engineers to ensure data is efficiently ingested, processed, and prepared for model training.
• Excellent problem-solving and communication skills.
• Mentor junior engineers and enforce best practices in coding, architecture, and data engineering.

• Education:
  Bachelor’s or Master’s in Computer Science, Data Engineering, or related field.
• Experience: 10+ years in Hadoop ecosystem development, 2+ years in data engineering for ML projects.
• Certifications:
  Cloudera/Hortonworks or equivalent (preferred).