Senior Kafka Developer

Required Technical/Functional Skills

• Minimum 10 years of experience in software development and data engineering.
• Strong hands‑on experience with Apache Kafka development and implementation.
• Expertise in designing and developing real‑time data streaming applications and event‑driven architectures.
• Experience building scalable, reliable, and fault‑tolerant data pipelines.
• Strong understanding of Kafka components including:
  • Kafka Brokers
  • Topics and Partitions
  • Producers and Consumers
  • Kafka Streams
  • Kafka Connect
  • Schema Registry
• Experience with real‑time stream processing using Kafka Streams and/or KSQL.
• Knowledge of Hadoop ecosystem technologies preferred.
• Strong troubleshooting and performance optimization skills.

• Design, develop, and maintain real‑time streaming applications using Apache Kafka.
• Build and optimize high‑throughput, fault‑tolerant data pipelines.
• Develop and maintain Kafka producer and consumer applications.
• Configure, manage, and monitor Kafka clusters, brokers, topics, and partitions.
• Implement integrations using Kafka Connect with external systems and data sources.
• Develop stream processing solutions using Kafka Streams and KSQL.
• Manage data serialization formats and resolve serialization‑related issues.
• Analyze performance bottlenecks and optimize Kafka cluster performance.
• Troubleshoot message delivery, connectivity, and data processing issues.
• Collaborate with engineering teams to design scalable event‑driven solutions.

• Experience with large‑scale distributed systems and cloud‑based data platforms.
• Strong understanding of data engineering and streaming architecture patterns.
• Experience working with Hadoop and big data processing environments.
• Excellent analytical, troubleshooting, and communication skills.