Sr. Data Engineer

Mandatory skills -
GBQ (Google Big Query), ETL, Python

• Experience in Google Cloud Platform (GBQ, GCS, Kubernetes POD operator and Image creation, Composer, DAG creation)
• Python Programming Expert
• Experience in Ascend tool
• Create Data flow, Data service, Read and Write connection for the various sources.
• Failure Notification settings (Ascend Webhook notification, Scheduling in Ascend)
• Big query merge to perform merge
• Custom Read and Write connector using python framework
• Good understanding in Error logging
• Experience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling)
• Experience in DBT to create the lineage in GCP – Optional
• Worked in Dev-Sec-Ops (CI/CD) environment.
• Experienced with containerized execution/code containerization
• Interact with the platform leads and 3rd party application leads to understand and analyze the various interfaces and data integration needs to create technical user stories
• Contribute to the creation of technical design, estimation as applicable for the user stories and review with the EAC team and Product Owner
• Conduct and participate in code review sessions for the team deliverables
• Guide the team members and involve in development and unit testing
• Work with business users for UAT and assist QA team accordingly for defects fixing
• Help the team troubleshoot critical issues in development, staging or production.
• Retail & Manufacturing Domain expertise.