Hadoop Engineer

Hadoop Engineer (SME) role supporting Next Gen Platforms built around Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more). Requires experience in cluster management of vendor based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc. Hadoop Engineer is involved in the full life cycle of an application and part of an agile development process.

They require the ability to interact, develop, engineer, and communicate collaboratively at the highest technical levels with clients, development teams, vendors and other partners. The following section is intended to serve as a general guideline for each relative dimension of project complexity, responsibility and education/experience within this role.

Hadoop Engineer (SME) role supporting Next Gen Platforms built around Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more). Requires experience in cluster management of vendor based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks, Snowflake, Talend, Greenfield, ELK, KPMG Ignite etc. Hadoop Engineer is involved in the full life cycle of an application and part of an agile development process.

They require the ability to interact, develop, engineer, and communicate collaboratively at the highest technical levels with clients, development teams, vendors and other partners. The following section is intended to serve as a general guideline for each relative dimension of project complexity, responsibility and education/experience within this role.

Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise

Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, Open Shift, Docker-Container Cluster Management and Administration

Integrates solutions with other applications and platforms outside the framework

He / She will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident / problem / capacity management

Serves as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs

Hadoop, Kafka, Spark, Impala, Hive, Hbase etc.

Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator's role

Intimate knowledge of fully integrated AD/Kerberos authentication

Experience setting up optimum cluster configurations

Debugging knowledge of YARN.

Hands-on with analyzing various Hadoop log files, compression, encoding, file formats

Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and Postgres

Strong technical knowledge:
Unix/Linux;
Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure.

Experience in Monitoring Alerting, and Job Scheduling Systems

Being comfortable with frequent, incremental code testing and deployment

Strong grasp of automation / Dev Ops tools - Ansible, Jenkins, SVN, Bitbucket

Experience working on Big Data Technologies

Cloudera Admin / Dev Certification

Certification in Cloud, Docker-Container, Open Shift Technologies

Equal Opportunity

Employer:

Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.