Kafka Software Engineer

Responsibilities

• Design and build large-scale data platforms to support our AI research and autonomy stack development, handling petabytes of multimodal sensor data from real-world driving scenarios
• Work on data curation and tagging platforms that enable efficient dataset discovery, labeling workflows, and quality assessment across diverse driving conditions
• Build high-performance data processing systems using modern distributed computing frameworks to transform raw sensor data into training-ready formats
• Participate in developing a central data and machine learning platform that can be used across all verticals of the company; collaborate across product verticals during early "0-1" stage to define deployment at scale
• Engage in data ingestion from a production fleet, data processing and storage (TBs/car/day), labeling infrastructure, and machine learning infrastructure
• Use technologies such as Apache Spark, Apache Hudi, Trino, Apache Kafka, Flyte, Kubernetes, Python, Golang, and Java

• Strong backend engineering experience
• Problem‑solving skills and experience working with cross‑functional teams in fast‑paced environments
• 2+ years of professional experience
• A Bachelor’s degree in Computer Science, Software Engineering, or equivalent
• Hands‑on experience with modern data stack technologies including Apache Spark, Hudi, Trino, Kafka, or similar distributed data processing frameworks
• Knowledge of data lake architectures, streaming systems, and workflow orchestration platforms like Flyte

Don’t meet every single requirement? If you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway. You may be just the right candidate for this or other roles.

• Health Insurance:
  Applied covers 100% of the cost and offers medical, dental, vision, and life insurance
• Fitness Stipend:
  Our wellness program supports your health and fitness goals. We pay for your trainers, gym memberships, massages, and more!
• 401(k) Match: 50% employer matching to help you save money for retirement
• Learning Stipend:
  We invest in your learning and growth by reimbursing you for educational and training expenses
• Parental leave: 12‑week, fully paid parental leave to bond with a newborn child or new adopted or foster child
• Catered lunch, expensed dinner, on‑site meals and snacks