PySpark Data Engineer — ETL & Big Data Pipelines
Job Description & How to Apply Below
Responsibilities
Data Pipeline Development:
Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.
Data Ingestion:
Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.
Data Transformation and Processing:
Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements.
Performance Optimization:
Conduct performance
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×