Data Engineer

Punch is a full service digital agency with offices in New York, Silicon Valley, LA, Boston, Stockholm, and Phuket, Thailand. We pride ourselves on tackling our clients' most challenging tasks and are at the forefront of creating cutting-edge technology, founded by former Google Engineers and now with over 75 staff.

We are seeking innovative thinkers eager to expand their knowledge. Check out our work at:

We are looking for a highly talented senior/lead data engineer to design and implement a reliable and scalable Audience Management Big Data Platform (500+ Terabytes).

Responsibilities:

• Build, enhance, and scale our existing Big Data Platform to process over 500 Terabytes of data from various third-party providers.
• Own the complete data pipeline, including ingestion, validation, transformation, and storage.
• Design and write clean, robust server-side code using Spark and Scala.
• Conduct R&D to evaluate new technologies and generate innovative ideas, including patentable IP.
• Mentor team members and collaborate closely with them.
• Partner with product managers to support the product roadmap and business needs.

Required Skills:

• 10-15 years of experience in software development, primarily in the Big Data domain using Spark and Hadoop ecosystem.
• At least 5+ years of experience in Spark and Scala (Skill level: 8+ out of 10).
• Bachelor's degree in Computer Science or equivalent.
• Over 5 years of experience designing, building, and launching efficient and reliable data pipelines for large and small data volumes.
• Strong background (5+ years) in ETL processing for datasets exceeding 250 Terabytes.
• Experience working with datasets over 250 Terabytes for ETL using Spark and Scala.
• At least 3 years of experience working in an Agile environment (SCRUM).

Nice to Have

Skills:

• Experience with AWS services such as S3, EMR, EC2, RDS.

• Type:
  Full-time
• Education:
  
  Bachelor's degree
• Experience:
  
  5+ years in designing and building data pipelines

Our team includes former Google Engineers and Designers based in Silicon Valley, New York, and Phuket, Thailand. Our engineers are paid $150,000 or more, with opportunities to work from our Phuket office one month per year, expenses paid, to enjoy life and creativity. Join us to work on exciting projects with a passionate team dedicated to building disruptive products.