BigData Solution Architect - NJ

Requirements

• 10+ years of overall experience in architecting and building large scale, distributed big data solutions in the capacity of software architect, solution architect, or engineering leader.
• Proven track record of consistently architecting, designing, developing and/or implementing an end— to—end Big Data Lake, Business Intelligence - Tableau/Power BI/Qlik, Data Science project.
• Solid experience in building Big Data Pipelines (Batch and NRT) on Hadoop Ecosystem including HDFS, Hive, Spark, Scala, Sqoop, Kafka, NiFi, and real‑time streaming technologies and host of big data open source stack. Well versed with performance tuning of compute heavy workloads.
• Working experience in Cloudera distribution and AWS/Azure/GCP Cloud. Solid understanding of Data Quality, Data Governance and Data Security.
• Experience in big data solutions like Impala, Oozie, Flume, Sqoop or Zoo Keeper. Proficient in Python/R, Java, Scala, Ruby or C++.
• Experience with one of the large cloud‑computing infrastructure solutions like AWS Redshift, Snowflake, SQL DW, Big Query.
• Good experience in database and hands‑on experience in big data technologies such as Hadoop/Hive/Spark/Mongo
  
  DB, with experience in data ingestion, data wrangling, data virtualization technologies such as Stream Sets, Trifacta, Denodo will be a big plus.
• Strong analytical skills - ability to develop an idea into solution, define features, qualitative and quantitative analysis.
• Knowledge of Healthcare/Pharmaceutical industry experience is an added advantage.
• To be able to work in a fast‑paced agile development environment.

• Mid‑Senior level

• Full‑time

• Other

• IT Services and IT Consulting