Data Engineer - AWS - Databricks - SQL

Position (Designation)   Senior Data Engineer - AWS - DATABRICKS
Experience -- 4-7 Years of relevant experience

Location   Vikhroli, Mumbai

Function   Digital

Job      Profile
KRA

1) Identifying & driving Digital Transformation initiatives.
2) Creation and implementing cloud-based architecture.
3) Creation and implementing of advanced analytics use cases.
4) Collaboration with internal and external teams
5) Create Presentation / Proposal on Value proposition

Job

Description:

- Seeking Senior Data Engineer for our Data CoE team to help us implement advanced analytics solution on both on-premises and AWS environments in our Enterprise Data Lake.
The incumbent must have a sound understanding of databases, relational structures, dimensional data modelling, structured query language (SQL) skills, data warehouse and reporting techniques.
This position is responsible for the successful delivery of advanced analytics, ML/ AI solution for various use cases.
1)     Identifying & driving Digital Transformation initiatives.
- Work with business teams to understand the business needs and how emerging technologies can be leveraged.
- Ideation, conceptualization & analysis of Digital opportunities across the value chain including manufacturing, supply chain, workplace & customer experience.
- Work closely with vendors for planning, executing & supporting Digital projects.
- Working closely with end users and understand the use case in question.
- Design and implement the use case.
2)     Creation and implementing cloud-based architecture.
- Hands on experience in Python programming and deploying ML models.
3)     Creation and implementing of advanced analytics use cases.
- Working closely with end users and understand the use case in question.
- Design and implement the use case.
4)     Collaboration with internal and external teams
- Ability to collaborate on a team with infrastructure, BI report development and business analyst resources and clearly communicate solutions to both technical and non-technical team members. Design and implement the use case.
- Coordinate with vendors and bridge the gap amongst teams.
5)     Create Presentation / Proposal on Value proposition.
- Create high quality presentations and value proposition to create stakeholder buy-in
- Engage with internal stakeholders to evangelize the benefits of Digital technologies and drive cultural change.

Requisite      Qualification

Essential   Bachelor s in engineering
(Computer application/Information & Technology/ Electronics and Telecomm)

Preferred   Data Engineering or Data Science Certification

Requisite      Experience

Essential  4 to 8 yrs of relevant experience

Preferred

- AWS Certified Database Specialty or
- AWS Certified Data Analytics

Skills      Required

Special      Skills      Required

Databricks:
AWS: S3, DMS, Redshift, EC2, VPC, Lambda, Delta Lake, Cloud Watch etc.
Bigdata:
Databricks, Spark, Glue and Athena
Expertise in Lake Formation, Python programming, Spark, Shell scripting
Minimum Bachelors degree with 5+ years of experience in designing, building, and maintaining Databricks and AWS data components
3+ years of experience in data component configuration, related roles and access setup
Expertise in Python programming
Knowledge in all aspects of Dev Ops (source control, continuous integration, deployments, etc.)
Strong hands-on coding skills in Python, processing large-scale data set and developing machine learning models. Experience programming in Python, R, and SQL.
Expertise in deploying use cases and AI/ML models in standalone and cloud based systems and services.
Knowledge in all aspects of Dev Ops (source control, continuous integration, deployments, etc.)
Comfortable working with Dev Ops:
Jenkins, Bitbucket, CI/CD
Hands on ETL development experience, preferably using or SSIS.
SQL Server experience required
Strong analytical skills to solve and model complex business requirements.
Sound understanding of BI Best Practices/Methodologies, relational structures, dimensional data modelling, structured query language (SQL) skills, data warehouse and reporting techniques.
Comfortable with creating data models and visualization using Power BI

Preferred Skills Required

Good understanding of machine learning techniques and algorithms, including clustering, anomaly detection, optimization, neural network etc.
Comfortable in deploying AI/ML models (ML Ops) in standalone and cloud based systems and services.
Experience working in the SCRUM Environment.
Experience in Administration (Windows/Unix/Network/Database/Hadoop) is a plus.
Experience in SQL Server, SSIS, SSAS, SSRS
Ability to collaborate on a team with infrastructure, BI report development and business analyst resources, and clearly communicate solutions to both technical and non-technical team members.