Senior Data Engineer

Job Title:

Senior Data Engineer – GCP

Location;
Chennai

Experience:

5- 10 Years

Role Overview

We are seeking a highly skilled Senior Data Engineer – GCP to design, develop, and optimize scalable data solutions on Google Cloud Platform. The ideal candidate will have strong hands-on expertise in Big Query, PySpark, and GCP data services, with experience building robust ETL frameworks and modern data platforms.

Key Responsibilities

- Design and develop robust, scalable, reusable, and efficient ETL pipelines on GCP.
- Implement and manage end-to-end GCP ETL frameworks.
- Build and optimize Data Lake and Data Warehouse solutions.
- Develop and manage complex transformations using Big Query SQL and PySpark/Python.
- Work extensively with GCP services including Dataproc, Dataflow, Cloud Composer, Pub/Sub, Cloud Functions, Kubernetes, and Cloud Fusion.
- Optimize Big Query architecture, manage datasets, and ensure performance tuning across workloads.
- Collaborate with cross-functional teams to understand business requirements and deliver data-driven solutions.
- Follow CI/CD best practices using Jenkins and Git repositories.
- Ensure data quality, governance, and best engineering practices across projects.

Required Skills

- Strong expertise in GCP data ecosystem and ETL framework development
- Hands-on experience with Big Query (architecture, data types, optimization)
- Strong programming skills in Python and Py Spark

- Experience with Dataproc, Dataflow, Cloud Composer, Pub/Sub, Cloud Functions, Kubernetes
- Good understanding of Data Lake and Data Warehouse concepts

- Experience with Jenkins and Git-based workflows

Good to Have

- DBT tool expertise and data solutioning experience
- Banking domain knowledge
- GCP Certification
- Strong communication skills and proactive team collaboration