Spark, HDFS & Kafka Administrator/Engineer - NJ onsite
Job in
Jersey City, Hudson County, New Jersey, 07390, USA
Listing for:
Yoh, A Day & Zimmermann Company
Full Time
position
Listed on 2026-11-16
Job specializations:
-
IT/Tech
Job Description & How to Apply Below
Please contact
Renu Goel
Onsite in Jersey City
Must Haves:
* Great Communication, able to explain everything in detail
* Linux Admin - log in and perform commands
* Hands-on 3-5 years min experience Cloudera Cluster, HDFS, Spark, Kafka
We are seeking an experienced Spark, HDFS, and Kafka Administrator/Engineer to manage, support, and optimize enterprise-grade big data platforms. Deep hands-on expertise with Apache Spark, HDFS, and Kafka is required and will be the primary focus of this role. Experience administering these technologies within a Cloudera environment is preferred but secondary to strong expertise in the underlying technologies.
Main areas of responsibilities:
- Spark Administration:
Deploy, configure, monitor, tune, and troubleshoot Apache Spark environments and workloads. Support Spark job performance, resource management, capacity planning, and production operations. - HDFS Administration:
Manage and support HDFS storage, including capacity, performance, availability, permissions, replication, and troubleshooting. Strong understanding of HDFS architecture and integration with distributed compute platforms is required. - Kafka Administration:
Deploy, configure, manage, monitor, and troubleshoot Apache Kafka clusters, topics, producers, and consumers. Support performance, capacity, availability, security, and production operations. - Monitoring and Performance Tuning:
Monitor platform connectivity, health, capacity, and performance using tools such as Grafana, Splunk, and relevant platform management tools. Proactively identify and resolve performance bottlenecks across Spark, HDFS, and Kafka. - Security and Compliance:
Implement and manage security configurations, including Kerberos, SSL/TLS, authorization policies, HDFS ACLs, and enterprise IAM/LDAP integrations. - Automation and Scripting:
Develop and maintain automation using Python, Bash, or Perl for routine administration, configuration management, monitoring, and operational support. - Troubleshooting and Support:
Provide expert-level troubleshooting and technical support for Spark, HDFS, Kafka, and related big data technologies, including participation in an on-call rotation. - Platform Administration:
Support installations, patching, upgrades, migrations, and platform lifecycle activities while minimizing downtime. Cloudera Hadoop/CDP administration will be part of the role but is secondary to expertise in Spark, HDFS, and Kafka.
- Excellent problem-solving, analytical, and communication skills.
- Hybrid onsite 4 days a week.
- Minimum 3 years of hands-on production experience administering and supporting Apache Spark, HDFS, and Kafka.
- Strong, demonstrable expertise in Spark
Estimated Max Rate: $70.00
What’s In It for You?
We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh’s network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh’s extensive talent community that will provide you with access to Yoh’s vast network of opportunities and gain access to this exclusive opportunity available to you.
Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:
- Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
- Health Savings Account (HSA) (for employees working 20+ hours per week)
- Life & Disability Insurance (for employees working 20+ hours per week)
- Met Life Voluntary Benefits
- Employee Assistance Program (EAP)
- 401K Retirement Savings Plan
- Direct Deposit & weekly epayroll
- Referral Bonus Programs
- Certification and training opportunities
Any pay ranges displayed are estimations. Actual pay is…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction