GCP Cloud Engineer

Mandatory skills:

• GCP Composer (Apache Airflow)

• Fix and enhance Dataflow and/or Dataproc data ingestion pipelines (batch & streaming).
• Have a good understanding of GCP Composer (Apache Airflow) environments.
• Manage Airflow DAGs and troubleshoot Airflow‑related issues.
• Monitor and optimize Composer performance and scalability.
• Maintain GCP infrastructure including services like:
  • Google Cloud Storage (GCS)
  • Big Query (BQ)
  • Cloud Dataflow (Apache Beam)
  • Cloud Dataproc
  • Cloud Functions
  • Cloud Run
• Have a good understanding of:
  • IAM and service account permissions
  • Secret Manager
• Monitor GCP usage and quotas, and proactively prevent quota-related issues.
• Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
• DB design experience (excellent RDBS‑PLSQL knowledge).
• Design Spring Boot APIs.
• Analyze, design, create Docker file.
• Knowledge on Angular (good to have).
• Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.
• Collaborate with Dev Ops and development teams to manage CI/CD pipelines using Jenkins and other automation tools.
• Ensure security, compliance, and cost‑efficiency across the cloud environment.
• Document system configurations, procedures, and best practices.
• Proficient in either Java or Python programming languages.
• Excellent problem‑solving and troubleshooting skills.
• Strong communication and documentation abilities.
• Knowledge on DNS and SSO configuration setup.
• Knowledge on CDC Pipelines/Application (good to have).