Kafka Lead

Location: Bengaluru

About Aventis Technology

Aventis Technology sits at the powerful intersection of management consulting and custom IT services. We partner with forward-thinking organizations to deliver strategic business outcomes through the intelligent application of technology. Our unique hybrid approach combines deep business acumen with technical expertise to transform challenges into opportunities for growth, efficiency, and competitive advantage. We collaborate with clients across industries to solve complex problems, accelerate digital transformation, and drive measurable value.

Learn more at

Position:
Kafka Platform Lead

Experience:

10–14 years, with 4–6 years leading Kafka or streaming platforms

Role Summary

Aventis Technology is seeking a Kafka Platform Lead to own the architecture, reliability, and operational excellence of our enterprise event streaming platform. This leader will provide technical vision, governance, and execution responsibility for Kafka as the foundation of real-time integrations and data pipelines.

As a strategic member of the platform organization, you will collaborate with product managers, integration leads, engineering teams, and infrastructure partners to ensure Kafka enables scalable, resilient, and secure business outcomes.

Key Responsibilities

Strategic Platform Leadership

- Define and evolve the enterprise Kafka architecture, covering:
- Self-managed clusters
- Managed cloud services (e.g., Confluent Cloud or cloud-native offerings)
- Multi-region replication and disaster recovery
- Establish standards for topic design, retention policies, throughput, and capacity planning.

Delivery and Governance

- Lead design reviews, architecture sessions, and platform governance forums.
- Partner with product and integration leads to shape a strategic roadmap aligned to business priorities.
- Define platform usage patterns, best practices, and integration standards.

Reliability & Operational Excellence

- Own reliability engineering for Kafka, including production readiness, observability, incident response, and SLAs/SLOs.
- Drive automation and tooling for deployment, monitoring, scaling, and recovery.
- Lead post-incident reviews and implement systemic improvements.

Ecosystem Tooling & Optimization

- Govern Kafka ecosystem components:
- Kafka Connect and connectors
- Schema Registry and versioning
- Stream processing frameworks (Kafka Streams, ksql

DB)
- Define reusable patterns for retries, error handling, dead-letter queues, replay mechanisms, and idempotency.

Required Skills & Experience

- Deep hands-on experience with Apache Kafka internals and production deployments.
- Expertise in distributed systems, networking, performance tuning, and cluster operations.
- Strong leadership background, guiding cross-functional technical teams.

- Experience with schema governance (Avro, Protobuf, JSON Schema).
- Proven ability to drive reliability, scalability, and observability in enterprise environments.