Big Data Engineer

Job Summary

Our client is seeking a Big Data Engineer to join their team in Santa Monica, California. The role involves designing and building core components of a large‑scale data platform for both real‑time and batch processing, owning key features of big data applications that evolve with business needs. You will develop next‑generation, cloud‑based big data infrastructure supporting batch and streaming workloads, continuously improving performance, scalability, reliability, and availability.

The position promotes engineering excellence, best practices such as design patterns, CI/CD, thorough code reviews, and automated testing, while driving innovation and contributing new ideas using cutting‑edge technologies. Responsibilities include participating in the full software development lifecycle—system design, experimentation, implementation, deployment, and testing—and collaborating closely with program managers, product managers, SDETs, and researchers in an open, agile, and highly innovative environment.

• Bachelor’s degree in a STEM field such as Science, Technology, Engineering, or Mathematics
• 5+ years of relevant professional experience
• 4+ years of professional software development experience using Java, Scala, Python, or similar programming languages
• 3+ years of hands‑on big data development experience with technologies such as Spark, Flink, Single Store, Kafka, NiFi, and AWS big data tools
• Strong understanding of system and application design, architecture principles, and distributed system fundamentals
• Proven experience building highly available, scalable, and production‑grade services
• Genuine passion for technology with the ability to work across interdisciplinary areas and adopt new tools or approaches
• Experience processing massive datasets at the petabyte scale
• Proficiency with cloud infrastructure and Dev Ops tools, such as Terraform, Kubernetes (K8s), Spinnaker, IAM, and ALB
• Hands‑on experience with modern data warehousing and analytics platforms, including Click House, Druid, Snowflake, Impala, Presto, Kinesis, and more
• Familiarity with common web development frameworks, such as Spring Boot, React.js, Vue.js, or Angular

• Medical, Dental, & Vision Insurance Plans
• Employee‑Owned Profit Sharing (ESOP)
• 401(k) offered

The approximate pay range for this position is between $52.00 and $75.00 per hour. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.