Senior Data Engineer

Job Summary We are looking for a Senior Data Engineer with strong experience in real-time data streaming using Apache Kafka. The ideal candidate will design and build scalable data pipelines, streaming architectures, and data platforms to support real-time analytics and data-driven applications.

• Design, develop, and maintain real-time data pipelines using Apache Kafka
• Build scalable stream processing solutions using Kafka Streams, Spark Streaming, or Flink
• Develop and optimize ETL/ELT pipelines for large-scale data processing
• Integrate streaming pipelines with data lakes, data warehouses, and analytics platforms
• Work with cross-functional teams including Data Scientists, Product Managers, and Analysts
• Ensure data reliability, scalability, and performance optimization
• Implement data governance, monitoring, and alerting for streaming systems
• Troubleshoot production issues and optimize streaming architecture

• 8+ years of experience in Data Engineering
• Strong hands‑on experience with Apache Kafka / Kafka Streaming
• Experience with Python, Java, or Scala
• Strong knowledge of real-time streaming architectures
• Experience with Spark, Flink, or Kafka Streams
• Strong SQL and data modeling skills
• Experience working with cloud platforms (AWS, GCP, or Azure)
• Familiarity with data lake technologies (S3, Delta Lake, Snowflake, etc.)

• Experience with Databricks or Snowflake
• Experience with containerization (Docker, Kubernetes)
• Knowledge of CI/CD pipelines and Dev Ops practices
• Experience with monitoring tools like Prometheus, Grafana, or Splunk

• Experience with event-driven architecture
• Experience building high-throughput, low-latency data systems