More jobs:
Senior Data Engineer: AWS, Streaming & Data Quality
Job in
Fort Mill, York County, South Carolina, 29715, USA
Listed on 2026-05-28
Listing for:
EOne Infotech
Full Time
position Listed on 2026-05-28
Job specializations:
-
IT/Tech
Data Engineering
Job Description & How to Apply Below
- Full Time
- Fort Mill, SC (3 days hybrid)
- Posted 3 months ago
- ABOUT US
- Leadership
- SERVICES
- JD Edwards
- Oracle Cloud
- AI Solutions
- Net Suite
- Salesforce Implementation
- Blockchain
- TrakSYS MES
- Managed IT Services
- Microsoft Dynamics 365
- Power BI
- INDUSTRIES
- PRODUCTS
- One Xcel
- IoT Solutions
- RESOURCES
- Whitepapers
- CAREERS
Sr. Data Engineer (Mid–Senior Level) – AWS & Streaming
- Full Time
- Fort Mill, SC (3 days hybrid)
- Posted 3 months ago
Job Description :
Experience Level – 13-15+ Years
Job Description
We are seeking a Mid–Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines, implement robust data validation and monitoring processes, and support mission-critical analytics platforms.
Key Responsibilities :
- Develop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python
- Build event-driven workflows using AWS Lambda
- Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink
- Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation
- Optimize data processing performance, scalability, reliability, and cost in cloud environments
- Collaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline
- Strong hands-on experience with Python and Py Spark
- Proven expertise in AWS Glue, Lambda, and other cloud-native data services
- Solid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns)
- Demonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection)
- Strong understanding of distributed data processing and scalable architecture patterns
Skills:
- Experience with Apache Flink for real-time stream processing and stateful computations
- Knowledge of KSQL or other streaming SQL engines
- Exposure to CI/CD pipelines, IaC (Terraform/Cloud Formation), and Dev Ops practices
- Familiarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi
- Experience working in enterprise or financial data environments
Number of Positions :
Multiple
First Name
Last Name
Contact Number
Current Location
Zip code
Relevant Experience
Total Experience
Key Skills
Upload Resume
Not readable? Change text.
Enter Captcha Code
Sr. Data Engineer (Mid–Senior Level) – AWS & Streaming
- Full Time
- Fort Mill, SC (3 days hybrid)
- Posted 3 months ago
Key Responsibilities :
- Develop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python
- Build event-driven workflows using AWS Lambda
- Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink
- Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation
- Optimize data processing performance, scalability, reliability, and cost in cloud environments
- Collaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline
- Strong hands-on experience with Python and Py Spark
- Proven expertise in AWS Glue, Lambda, and other cloud-native data services
- Solid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns)
- Demonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection)
- Strong understanding of distributed data processing and scalable architecture patterns
Skills:
- Experience with Apache Flink for real-time stream processing and stateful computations
- Knowledge of KSQL or other streaming SQL engines
- Exposure to CI/CD pipelines, IaC (Terraform/Cloud Formation), and Dev Ops practices
- Familiarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi
- Experience working in enterprise or financial data environments
Number of Positions :
Multiple
First Name
Last Name
Contact Number
Current Location
Zip code
Relevant Experience
Total Experience
Key Skills
Upload Resume
Not readable? Change text.
Enter Captcha Code
IT Services
- JD Edwards
- Oracle Cloud
- AI Solutions
- Net Suite
- Salesforce Implementation
- Blockchain
- Traksys
- Microsoft Dynamics 365 Services
- Power BI
- Health and Personal Care
- Manufacturing:
Food & Beverages - Energy, Utilities, Oil and Gas
- Paper goods, Construction and Industry Automation
- Automation
- IT
- Finance
- Leadership
- About Us
- Contact Us
- Careers
515 Plainfield Av,
Suite 203 Edison, NJ08817
© 2026 eOne Infotech All Rights Reserved #J-18808-Ljbffr
Position Requirements
10+ Years
work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×