Hadoop Lead

Ventures Unlimited is a service centric organization. Our success begins with our ability to apply our relationships, leverage technologies, and identify talent - often in combination - to an endless array of real-world customer needs

**** FULL TIME PERMANENT POSITION******

Position :
Hadoop Lead with Python
Location: Beaverton, OR
Duration: Full Time

• Design and implement Map Reduce jobs to support distributed processing using Java, Python, Hive, and Pig;
  Ability to design and implement end-to-end solution.
• Build libraries, user defined functions, and frameworks around Hadoop.
• Research, evaluate and utilize new technologies/tools/frameworks around Hadoop ecosystem.
• Develop user defined functions to provide custom Hive and Pig capabilities.
• Define and build data acquisition and consumption strategies.
• Define & develop best practices.
• Work with support teams in resolving operational & performance issues.
• Work with architecture/engineering leads and other teams on capacity planning.
• Work with Site-Operations team on configuration/upgrades of the cluster.
• Excellent communication skills.

• MS/BS degree in a computer science field or related discipline.
• 8+ years’ experience in large-scale software development.
• Experience with data warehousing, dimensional modeling and ETL development (including familiarity).
• Strong Java programming, shell scripting, Python, and SQL.
• Strong development skills around Hadoop, Map Reduce, Hive, Pig, Impala.
• Strong understanding of Hadoop internals.
• Good understanding of AVRO and JSON.
• Experience with build tools such as Maven.
• Experience with databases like Oracle.
• Experience with performance/scalability tuning, algorithms and computational complexity.
• Proven ability to work cross‑functional teams to deliver appropriate resolution.
• Experience with open‑source No
  
  SQL technologies such as HBase and Cassandra.
• Experience with messaging & complex event processing systems such as Kafka and Storm.
• Machine learning framework (Nice to have).
• Statistical analysis with Python, R or similar.