Big Data Developer

Skills :  Big Data; CI/CD; ETL - Big Data / Data Warehousing; GCP;
Python; SQL;
Java

JD:
Senior hands-onGCP Data Engineer who can work independently across a variety of GCP Big Data services.

Strong experience working with Google Cloud Platform (GCP) data services, including Big Query and Bigtable Proficiency in Python programming (Java experience is a plus)
Strong hands-on experience with Cloud Composer (Airflow) for workflow orchestration

Hands-on experience with Dataproc for large-scale data processing

Good to have experience in building messaging and event-driven data pipelines using Pub/Sub

Experience with CI/CD pipelines (Git Hub Actions)
Marketing Platforms team within US Consumer and Digital Technology division is responsible for enabling creation, execution and tracking of Marketing Campaigns across all Amex products and channels."Flywheel" initiative aims to modernize our technology stack to improve Marketer"s operational efficiency and bring campaigns to market quicker, creating more dynamic, personalized customer experience.

An individual in this role will work on brining marketing data into Unified Marketing Data Layer on our GCP Big Data platform to facilitate reporting and analytics of marketing campaign performance.