More jobs:

AWS Data Engineer: S3 & Spark Pipelines

Job in Charlotte, Mecklenburg County, North Carolina, 28245, USA

Listing for: Veriipro

Full Time position
Listed on 2026-05-28

Job specializations:

IT/Tech
Data Engineering, Data Warehousing

Salary/Wage Range or Industry Benchmark: 80000 - 100000 USD Yearly USD 80000.00 100000.00 YEAR

Seeking an experienced AWS Data Engineer with strong expertise in Amazon S3 and enterprise data pipelines. The role involves building scalable ETL pipelines, managing data in AWS environments, and supporting big data processing using Spark/Hadoop technologies.

Roles and Responsibilities

Design, develop, and maintain ETL/ELT data pipelines for large-scale data processing.
Utilize Amazon S3 for data storage, retrieval, and management within data workflows.
Develop data ingestion and transformation pipelines using PySpark and SQL.
Write Shell/Python scripts to automate data movement between S3 and other platforms.
Implement S3 features such as versioning, lifecycle policies, access control, and encryption.
Validate HiveQL queries, HDFS structures, and Spark-based processing in Hadoop environments.
Monitor and schedule batch workflows using Auto Sys or similar tools.
Collaborate with cross-functional teams and maintain technical documentation.

Required Skills

AWS Data Engineering
Amazon S3
PySpark / Spark
SQL
Shell Scripting
Auto Sys

Preferred Skills

Hadoop, Hive, HDFS
Oracle
Cloudera Platform
Banking or Payments domain experience
Knowledge of Data Warehousing, ETL/ELT, Data Quality

#J-18808-Ljbffr

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction