More jobs:
AWS Data Engineer: S3 & Spark Pipelines
Job in
Charlotte, Mecklenburg County, North Carolina, 28245, USA
Listed on 2026-05-28
Listing for:
Veriipro
Full Time
position Listed on 2026-05-28
Job specializations:
-
IT/Tech
Data Engineering, Data Warehousing
Job Description & How to Apply Below
Seeking an experienced AWS Data Engineer with strong expertise in Amazon S3 and enterprise data pipelines. The role involves building scalable ETL pipelines, managing data in AWS environments, and supporting big data processing using Spark/Hadoop technologies.
Roles and Responsibilities- Design, develop, and maintain ETL/ELT data pipelines for large-scale data processing.
- Utilize Amazon S3 for data storage, retrieval, and management within data workflows.
- Develop data ingestion and transformation pipelines using PySpark and SQL.
- Write Shell/Python scripts to automate data movement between S3 and other platforms.
- Implement S3 features such as versioning, lifecycle policies, access control, and encryption.
- Validate HiveQL queries, HDFS structures, and Spark-based processing in Hadoop environments.
- Monitor and schedule batch workflows using Auto Sys or similar tools.
- Collaborate with cross-functional teams and maintain technical documentation.
- AWS Data Engineering
- Amazon S3
- PySpark / Spark
- SQL
- Shell Scripting
- Auto Sys
- Hadoop, Hive, HDFS
- Oracle
- Cloudera Platform
- Banking or Payments domain experience
- Knowledge of Data Warehousing, ETL/ELT, Data Quality
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×