Cloud Platform Developer

ONLY USC/GC – W2 ROLE Must Have Skills

• Must have deep, hands‑on experience running Kafka in large‑scale production environments, including cluster operations, upgrades, patches, and migrations.
• Should understand Kafka internals such as partitions, replication, retention/compaction, and rebalance strategies.
• Kafka Administration
• Platform / SRE / Dev Ops Experience
• Kafka Ecosystem Tools
• Linux + Networking
• Automation / Scripting
• Monitoring / Observability
• Disaster Recovery

• AWS MSK / Apache Kafka Cloud:
  Experience with MSK operations and cloud‑aligned Kafka environments.
• Helpful for cross‑environment consistency between on‑prem and cloud.
• Hardware Refresh
  
  Experience:
  
  Prior work leading Kafka hardware refreshes or cluster rebuilds.

We’re seeking a senior contract Kafka/Confluent administrator to own and evolve our on‑prem event streaming platform, with a primary focus on Confluent Platform. You will lead planning and execution of a hardware refresh for our on‑prem clusters, drive reliability and performance, and embed Dev Ops/automation across provisioning, deployment, observability, and incident response. Experience with Apache Kafka and AWS MSK is desired for secondary support and cross‑environment alignment.

Comprehensive documentation and runbooks are required deliverables.

• Design, deploy, and operate highly available Kafka clusters (on‑prem, cloud, and/or managed services such as Confluent Cloud or AWS MSK).
• Manage topics, partitions, quotas, retention policies, and consumer group strategies for performance and cost.
• Own upgrades, patches, and migrations.
• Implement and manage Kafka components:
  Kafka Connect, Schema Registry, Mirror Maker/Confluent Replicator, REST Proxy; familiarity with Kafka Streams and ksqlDB is a plus.
• Performance tuning (producers/consumers, batching, compression, acks, ISR, controller health), throughput testing, and benchmarking.
• Capacity planning, partitioning strategy, and cluster right‑sizing.

• Hardware refresh plan: capacity model, sizing, architecture diagrams, migration/cutover strategy, risk register
• Implement and validate on‑prem clusters on refreshed hardware with performance benchmarks
• Operational documentation: standards, runbooks, monitoring/alerts configuration, backup/restore and DR playbooks.
• Knowledge transfer sessions and documentation handoff at milestones and project close.

• 5+ years in systems/platform engineering, SRE, or Dev Ops; 4+ years operating Kafka in production at scale.
• Deep knowledge of Kafka internals: partitions, replication, retention/compaction, rebalance strategies.
• Hands‑on with Kafka Connect, Schema Registry, Mirror Maker/Confluent Replicator.
• Strong Linux fundamentals; networking (TCP, DNS, load balancing), and performance analysis.
• Proficiency in automation/scripting.
• Monitoring/observability:
  Data Dog, Grafana, JMX exporters, and log aggregation.
• Experience with DR, multi‑region design, and incident management.
• Proven ability to produce clear, comprehensive documentation

• Experience with Apache Kafka and AWS MSK operations and integration.
• Experience executing hardware refreshes and major cluster rebuilds/migrations with minimal downtime.

5+ years

None