Hadoop Administartor

Job Description

Position:
Hadoop Administrator

Location:

Bridgewater, NJ

Duration: 6+ months

Client is seeking a Hadoop Administrator to manage large scale Hadoop cluster environment, handling all Hadoop environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring with good technical, organization, and communication skills. This position is located in Bridgewater, NJ site.

As part of the Global Infrastructure Services organization, the Data Management Platforms and Services team is looking for a Hadoop Administrator with a good knowledge of the Hadoop ecosystems to participate in the building of a new Hadoop service offering.

• Participate in the design, build and deployment of a new Hadoop platform & service to support all Big Data projects, including common service request, monitoring definition, backup and recovery strategy, and security.
• Assist in definition of an operation model and establishing support best practices for Hadoop cluster.
• Participate in POC's with applications and projects interested in Big Data Advanced Analytics, working on enabling/testing solutions and software as needed.
• Work closely with the Regional Service Delivery operation teams to perform training (KT Sessions with L2 and L3), support and optimize Hadoop cluster infrastructure.
• Support development and production deployments as required.
• Manage and monitor Hadoop cluster and platform infrastructure.
• Automate cluster node provisioning and repetitive operational tasks.
• Manage Hadoop stack support runbook in collaboration with the Regional Service Delivery operation teams.

• 3-4 years of experience with large scale Hadoop environment build and support including design, capacity planning, cluster setup, performance tuning and monitoring.
• Strong understanding of Hadoop ecosystem such as HDFS, Map Reduce, HBase, Zookeeper, Pig, Sqoop, Oozie and Hive.
• 2-3 years of experience with Cloudera Distribution of Hadoop (CDH).
• Experience with disaster recovery and business continuity practices in Hadoop stack.
• Deep understanding of Hadoop design principals, cluster connectivity, security and performance factors.
• Cloudera Certification CCA 500 preferred.
• Experience with Impala and Spark.
• Experience maintaining, troubleshooting and setting up large clusters.
• Thorough knowledge of current hardware systems commonly used in production environments.
• Ability to proactively identify, troubleshoot and resolve production system issues.
• Technical documentation skill on supported applications and operational tools.
• Strong knowledge in Hadoop monitoring tools.
• Experience with Oracle, SQL, Teradata database platforms is a plus; experience with MongoDB platform is a plus.
• Expertise in UNIX architecture, UNIX tools and UNIX shell scripting.
• Experience with RHEL 5 or 6 Linux.
• Experience with Amazon Cloud (AWS) not mandatory but a huge plus.