AWS Data Lead/Lead Consultant - Data Cloud Platform
Listed on 2026-07-07
-
Software Development
AWS, Data Engineering
AWS Data Lead / Lead Consultant Data on Cloud Platform
Location: Fort Mill, SC 29715 (Hybrid/Onsite)
Work Arrangement: Hybrid Candidates must be willing to work onsite. Candidates open to relocating to Fort Mill, SC will also be considered.
Contract Duration: 6 Months
Target
Start Date:
June 15, 2026
Interview Process: Virtual
Visa Requirement: Visa-independent candidates only
Position OverviewWe are seeking an experienced AWS Data Lead to design, develop, and lead enterprise-scale cloud data integration and data warehousing initiatives. The ideal candidate will have deep expertise in AWS Glue, PySpark, DBT, and Apache Airflow
, along with a proven track record of building scalable ETL/ELT pipelines and cloud-native data platforms.
This role combines technical leadership with hands‑on engineering and requires close collaboration with cross‑functional teams to deliver reliable, high‑performance data solutions.
Key Responsibilities- Lead the architecture, design, and implementation of scalable ETL/ELT solutions using AWS Glue and Py Spark .
- Develop and automate end‑to‑end data pipelines that support enterprise data integration and analytics initiatives.
- Build and manage workflow orchestration using Apache Airflow to ensure reliable and efficient data processing.
- Design cloud‑native, event‑driven architectures leveraging AWS services such as:
- AWS Glue
- AWS Lambda
- Amazon Event Bridge
- Amazon S3
- Amazon RDS (Aurora/PostgreSQL)
- Amazon MSK and/or Amazon Kinesis
- Implement data transformation and modeling best practices using DBT and advanced SQL techniques.
- Work with relational and cloud data platforms including Snowflake
, Aurora PostgreSQL
, PostgreSQL
, and Microsoft SQL Server
. - Build and maintain CI/CD pipelines and Infrastructure as Code (IaC) solutions using tools such as Terraform
. - Ensure high standards for data quality, reliability, scalability, and performance across all data pipelines.
- Provide technical leadership, mentor team members, and collaborate with business stakeholders to deliver strategic data solutions.
- Drive best practices in cloud engineering, Dev Ops, and data platform modernization.
- 10+ years of experience in data engineering, ETL development, or cloud data platform engineering.
- Extensive hands‑on experience with:
- AWS Glue
- Py Spark
- DBT (Data Build Tool)
- Apache Airflow
- Strong expertise in designing and implementing scalable ETL/ELT pipelines.
- Deep knowledge of AWS services, including Glue, Lambda, Event Bridge, S3, RDS (Aurora/PostgreSQL), and MSK/Kinesis.
- Proficiency in SQL, data modeling, and cloud‑native database technologies.
- Experience with CI/CD pipelines, Infrastructure as Code, and Terraform
. - Strong communication, leadership, and stakeholder management skills.
- Experience with Scala
. - Hands‑on experience with Snowflake
. - Experience implementing modern Dev Ops practices in cloud environments.
- Exposure to enterprise data warehouse modernization initiatives.
- AWS Certified Data Engineer
- AWS Certified Solutions Architect
, Py Spark , and Apache Airflow
.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).