Lead Data Engineer; GCP & Matillion
Job in
Encino, Los Angeles County, California, 91316, USA
Listed on 2026-07-01
Listing for:
E-Solutions
Full Time
position Listed on 2026-07-01
Job specializations:
-
IT/Tech
Data Engineering, Cloud Computing: Infrastructure & Operations, Data Warehousing
Job Description & How to Apply Below
Location: Encino
Senior Data Engineer
Role Overview The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and solutions on Google Cloud Platform (GCP). The role focuses on data ingestion, transformation, orchestration, and governance across enterprise data systems. The engineer will work closely with architects, data analysts, and business stakeholders to implement high-quality, performance-optimized data solutions in Big Query and related GCP services.
Key Responsibilities:
- Design and implement end-to-end data pipelines using Cloud Dataflow (Python/Apache Beam) for batch and streaming data.
- Develop, optimize, and maintain Big Query stored procedures (SPs), SQL scripts, and user-defined functions (UDFs) for complex transformations and business logic implementation.
- Build and manage data orchestration workflows using Cloud Composer (Airflow) with appropriate operators and dependencies.
- Establish secure and efficient connections to source systems for data ingestion and integration.
- Manage data ingestion workflows from on-premise and cloud sources into Google Cloud Storage (GCS) and Big Query.
- Execute history data migration from legacy data warehouses (preferably Snowflake, Teradata, Netezza, Oracle, SQL Server) to Big Query, ensuring accuracy and performance optimization.
- Design and maintain data validation and testing frameworks for ensuring data quality and reliability across pipelines.
- Implement data governance practices, including metadata management, lineage tracking, and access control.
- Collaborate with data analysts and architects to define scalable and reusable data models, views, and semantic layers in Big Query.
- Troubleshoot data pipeline failures, perform root cause analysis, and implement preventive measures.
- Optimize cost and performance of GCP workloads using best practices for Big Query and Dataflow.
Technical & Soft
Skills Required:
- Strong hands-on experience in Google Cloud Platform (GCP) with expertise in Big Query, Dataflow, Cloud Composer, and GCS.
- Proficient in Python programming for data engineering (Dataflow pipelines, validation scripts, automation).
- Expertise in Big Query SQL, Stored Procedures, Views, and User Defined Functions (UDFs).
- Experience with data migration from on-premise or cloud data warehouses (preferably Snowflake, Teradata, Netezza, Oracle, SQL Server) to Big Query.
- Strong understanding of ETL/ELT frameworks, data modeling, and schema design (Star/Snowflake).
- Familiarity with data governance, metadata, and lineage frameworks on GCP.
- Knowledge of data validation and testing techniques, including reconciliation, rule-based checks, and automation.
- Hands-on experience in workflow orchestration using Cloud Composer (Airflow) with custom operators.
- Strong SQL tuning and Big Query performance optimization skills.
- Good communication and collaboration skills to work with cross-functional teams in Agile environments.
- Proven ability to troubleshoot, optimize, and enhance complex data workflows at scale.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×