More jobs:
Job Description & How to Apply Below
We are seeking a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP), Generative AI, Python, SQL, ETL, Dataproc, and Airflow. The ideal candidate will play a key role in designing and implementing scalable cloud-based data platforms, modern ETL pipelines, and AI-enabled data solutions.
Key Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines using Python and SQL.
Develop cloud-native data engineering solutions on GCP.
Implement batch and real-time data processing pipelines using Dataproc and Dataflow.
Build and manage workflow orchestration using Apache Airflow / Cloud Composer.
Work on large-scale structured and unstructured datasets for analytics and AI use cases.
Integrate Generative AI and LLM-based capabilities into enterprise data platforms.
Optimize Big Query workloads and improve data processing efficiency.
Collaborate with data scientists, analysts, architects, and business teams to deliver data-driven solutions.
Ensure data quality, governance, scalability, reliability, and security.
Participate in architecture reviews and provide technical leadership and mentorship.
Required Skills
Strong experience in Google Cloud Platform (GCP) services:
Big Query
Cloud Storage
Dataflow
Pub/Sub
Dataproc
Cloud Composer / Apache Airflow
Hands-on experience in Generative AI / LLM solutions .
Strong programming expertise in Python .
Advanced SQL development and query optimization skills.
Extensive experience in ETL/ELT pipeline development .
Hands-on experience with workflow orchestration using Apache Airflow .
Experience in distributed data processing using Dataproc / Spark / PySpark .
Good understanding of data warehousing concepts and cloud architecture.
Experience with Git, CI/CD pipelines, and Agile methodologies.
Preferred Skills
Experience with Vertex AI, Lang Chain, RAG architecture, vector databases, or AI orchestration frameworks.
Exposure to streaming technologies such as Kafka or Pub/Sub.
Knowledge of Infrastructure as Code tools such as Terraform.
Familiarity with MLOps concepts and ML pipeline integration.
GCP certifications are a plus.
Educational Qualification
Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or related discipline.
Desired Candidate Profile
Excellent analytical and problem-solving skills.
Strong communication and stakeholder management abilities.
Ability to work in a fast-paced, collaborative environment.
Passion for cloud technologies, modern data platforms, and AI innovation.
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×