Hadoop Architect

Role:
Hadoop Architect (Spark, PySpark & CDP)

Location:

Pune
Work Mode:
Onsite

Experience:

10+ years

Company :
Smart Analytica Private limited is niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PB’s in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, telecom, manufacturing, insurance, and capital markets.

We are leaders in Big Data, Cloud and Analytics projects with super specialization in very large Data Platforms.

Empowering Your Digital Transformation with Data Modernization and AI

Mandatory

Skills:

Cloudera data platform, Pyspark, Hive, SQL, Iceberg and Open Data Contract Standard (ODCS)

Job Description:

Deep understanding and experience with modern Data Platforms –  Cloudera Data Platform (CDP)
Strong hands-on experience with  PySpark.

Experience with Cloudera Data Platform (CDE, CDW, Ozone, Airflow, SDX), Apache Ranger
Deep understanding of distributed data systems and Hive Metastore
Experience and understanding of cataloging, lineage, and governance
Experience / understanding Open Data Contract Standard (ODCS) and its implementation
Experience working with SQL, file formats (Iceberg/Parquet), and partitioning/bucketing strategies.
Nice to have
Experience modernizing enterprise finance systems or regulated environments
Knowledge of CI/CD, data engineering best practices
Understanding of financial data structures, accounting processes, or reconciliation workflows.