Principal Consultant

Job Description:

Role & Responsibilities:

1. 5+ Years hands on solid Experience on AWS services like S3, EMR, VPC, EC2, IAM, EBS, RDS, Glue, Lambda, Lake Formation etc.

2. 12+ years of IT experience in Data Engineering, Data Quality, Data Migrations, Data Architecture, Data Lake formation and Data Analytics.

3. Must have worked in producing architecture documents for small to large solution implementations.

4. In depth understanding of Spark Architecture including Spark Code, Spark SQL, Data frames, Spark Streaming, Spark MLiB, etc. Experience on handling very high-volume streaming data in various formats like JSON, XML, AVRO, Snappy etc.

5. Good Exposure to Kafka to design future capacity planning, partition Planning, Read and write.

6. Must have worked with Big Data and should have good knowledge of Mar reduce and Spark.

7. Must have very good working exposure on different kinds of databases like RDBMS, No SQL. Columnar, Document, distributed databases, Could Databases, in memory databases etc.

8. Python Exposure is an added advantage.