Job Description & How to Apply Below
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT data pipelines using Python and GCP services.
Develop high-quality, reusable, and efficient Python-based data processing solutions.
Build and manage data pipelines using Google Cloud Dataflow, Cloud Composer, Big Query, and Cloud Storage.
Design data models and optimize queries and workloads in Google Big Query.
Develop data ingestion processes from APIs, databases, files, and other data sources.
Implement data validation, quality checks, monitoring, and error-handling mechanisms.
Optimize data pipelines for performance, scalability, reliability, and cost.
Work with stakeholders to understand data requirements and translate them into technical solutions.
Implement CI/CD processes and follow Dev Ops best practices for data engineering solutions.
Troubleshoot production data pipeline issues and provide root-cause analysis.
Ensure data security, governance, access control, and compliance requirements are followed.
Prepare technical documentation for data pipelines, architecture, and operational processes.
Required Skills
Strong hands-on experience with Python for data engineering and automation.
Strong experience with Google Cloud Platform (GCP).
Hands-on experience with Big Query and SQL.
Experience with Google Cloud Storage (GCS).
Experience with Cloud Composer / Apache Airflow.
Experience with Dataflow / Apache Beam.
Strong understanding of ETL/ELT concepts and data pipeline architecture.
Good knowledge of relational databases and SQL optimization.
Experience working with REST APIs and different data formats such as JSON, CSV, and Parquet.
Experience with Git and CI/CD tools.
Understanding of cloud security, IAM, and data governance.
Preferred Skills
Experience with Pub/Sub and event-driven data pipelines.
Knowledge of Cloud Functions / Cloud Run.
Experience with Dataproc / Spark.
Knowledge of data warehousing and dimensional modeling.
Experience with Terraform or other Infrastructure-as-Code tools.
Exposure to data visualization tools such as Looker or Power BI.
Experience working in Agile/Scrum environments
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×