Kafka Admin

Cluster Management

• Install, configure, and maintain Confluent and AWS MSK Kafka clusters.
• Manage large-scale, multi-node Kafka cluster environments (on-prem and cloud).
• Troubleshoot and resolve issues related to Kafka brokers, topics, and data flow.
• Optimize Kafka configurations for performance, scalability, and fault tolerance.
• Plan and execute Kafka version upgrades and apply patches.
• Develop and maintain disaster recovery plans.
• Create and maintain documentation.

• Implement and manage security protocols.

• Monitor Kafka clusters to ensure optimal performance and availability.
• Collect and maintain performance metrics.
• Fine-tune Kafka configurations based on performance data.

• Provide guidance and support to developers using Kafka.

• Automate Kafka Cluster installations and topics/acls/connectors deployments using tools like Ansible, terraform, gitops.
• Develop and maintain automation for Kafka infrastructure.

• Strong understanding of Kafka architecture, concepts, and best practices.
• Proven experience in administering Confluent platform Brokers, Zookeepers, Schema registry, Restproxy, Ksql, Connectors and Control Center, Topics, ACLs etc.
• Experience in administering and supporting AWS MSK Clusters.
• Experience with Kafka Admin Client for managing topics programmatically.

• Experience with monitoring and alerting tools like Prometheus, Grafana, Alert manager, Dynatrace etc.
• Experience with Linux/Unix operating systems.
• Knowledge of software containerization and Kubernetes.
• Experience with scripting languages (Python, Shell).
• Automate installations and deployments using tools like Ansible, gitops, terraform etc.
• Experience with Git Lab pipeline.
• Knowledge of Service-Now, JIRA software.

• Strong troubleshooting skills.
• Excellent communication and collaboration skills.
• Ability to work as part of a team and independently.
• Experience in providing enhanced support to application teams.

Experience

Required:

6-8 years.