Software Engineer, Big Data

Distro Scale, Inc. is a fast-growing startup powering video experiences everywhere, wherever consumers are consuming video. We help create engaging video experiences & content reaching hundreds of millions consumers every month. Work hard, have fun, and make an impact! Great team environment. Well-funded, Profitable, Full healthcare, Catered lunches/drinks/snacks. Conveniently based in San Bruno, CA – near SFO, close to BART, Cal-Train with free shuttle.

Easy access to freeways (280, 101).

Our backend system process many TBs of data daily and produces a wide variety of real-time reports and metrics. The system drives critical business decisions and auto-pilots real-time web user experiences. It is built on top of highly scalable and fail-safe technologies like Hadoop, Impala, MySQL, No

SQL, and many great tools we built from scratch!

As a backend developer, you will be building a highly scalable, high-availability, and high performance ETL platform. Build efficient data processing pipelines to deliver real-time feedback to various components throughout production systems. Incorporate advanced analytic technologies to create intelligence that helps optimize and provide a better user experience. Develop fast runtime query engine that supports millions of queries per second, as well as data partitioning, geo and load balancing, instant failover, and disaster recovery.

We want our talented engineers to share our passion about building quality products and do hardcore coding. We don’t expect everyone to know every technology, but we do expect you to be eager about learning new skills and have what it takes to get things done.

Your role s:

• Develop a highly scalable, reliable, and real-time data processing pipeline
• Develop high performance runtime query platform that will scale to millions of queries per second
• Minimizing operational costs by leveraging the best technology and architecture
• Work closely with the rest of the team to bring our features into production
• Building tools and frameworks that enable reusable components and rapid development
• Have fun!

Your

Skills:

• Perl/Python/PHP, Linux, Bash, Hadoop/Impala, SQL, No
  
  SQL are required
• Flume, Spark, HIVE, HBase, node.js, Redis, ETL experiences are pluses!
• Experience in building reporting and real-time business intelligence frameworks
• Performance tuning on scripts and network
• 2~5 years of production experience, CS major or equivalent experience
• Quick learner and solid coder

Position based in San Bruno, CA.
Work Permit required.