Senior Big Data ​/ AWS Administrator

Role Overview
We are seeking a highly experienced Senior Big Data / AWS Administrator with 10+ years of hands-on experience in managing large-scale distributed systems. The ideal candidate will have deep expertise in AWS cloud infrastructure, Hadoop ecosystem, and Kafka administration, ensuring high availability, scalability, and performance of enterprise data platforms.
________________________________________

Key Responsibilities
Cloud & Infrastructure (AWS)

• Design, deploy, and manage scalable, secure, and highly available infrastructure on AWS.

• Administer core AWS services: EC2, S3, EMR, EKS, IAM, VPC, Cloud Watch, Lambda.

• Implement automated infrastructure provisioning using Infrastructure as Code (Terraform/Cloud Formation).

• Optimize cost, performance, and reliability of cloud environments.

• Develop disaster recovery and backup strategies.
Big Data Platform Administration (Hadoop)

• Install, configure, tune, and maintain Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark).

• Monitor cluster health, performance, and capacity planning.

• Troubleshoot cluster issues and ensure high availability using HA configurations (Name Node HA, etc.).

• Manage data ingestion and processing workflows.
Streaming Platform Administration (Kafka)

• Install, configure, and manage Apache Kafka clusters.

• Ensure high throughput, low latency, and fault-tolerant streaming systems.

• Manage topics, partitions, brokers, and retention policies.

• Perform Kafka cluster scaling, upgrades, and performance tuning.

• Implement monitoring using tools like Prometheus, Grafana, or Confluent Control Center.
System Operations & Monitoring

• Implement monitoring, logging, and alerting for all systems.

• Conduct root cause analysis and performance tuning.

• Ensure system security, access controls, and compliance standards.

• Maintain detailed documentation and operational runbooks.
Automation & Dev Ops

• Build CI/CD pipelines for infrastructure and platform deployments.

• Automate routine administrative tasks using scripting (Python, Shell, etc.).

• Collaborate with Dev Ops and engineering teams for platform improvements.
________________________________________
Required

Skills & Qualifications
Experience

• Minimum 10+ years of experience in system administration, with at least 5+ years in big data and cloud environments.

• Proven experience managing large-scale Hadoop clusters and Kafka environments.

• Strong hands-on experience with AWS cloud platform.

• Agentic AI experience

Technical Skills

• AWS services: AWS Administration, EC2, S3, EMR, IAM, VPC, Cloud Watch, Lambda

• Big Data :
Administration, Hadoop, HDFS, Hive, Spark,

• Kafka Administration