Senior Data Engineer
Job in
Atlanta, Fulton County, Georgia, 30383, USA
Listing for:
Aptonet
Full Time
position
Listed on 2026-11-13
Job specializations:
-
IT/Tech
Job Description & How to Apply Below
- We are currently seeking a Data Engineer experienced with cloud conversion/migration
, with a preference for Teradata to AWS migration
The Engineer must have Knowledge of Databricks. - Must have demonstrable hands‑on experience in creating/designing/implementing end‑to‑end data pipeline solutions. (Data ingestion, Data extraction, Data transformation, Data enrichment, Data loading, Data validation, Data processing, Data monitoring and maintenance, Data governance and security)
- In‑depth understanding of ETL and data ingestion processes used in large‑scale data warehouses
The Data Engineer is a skilled professional responsible for creating end‑to‑end data pipelines, managing data ingestion, transformation, enrichment, loading, validation, monitoring, and maintenance processes. This role plays a crucial part in building and optimizing data architecture, ensuring seamless data flow between various systems, and supporting data‑driven decision‑making. The Data Engineer should possess expertise in cloud migration, Databricks, ETL processes, and data governance, particularly for large‑scale data warehouses.
Key Responsibilities:- End‑to‑End Data Pipelines
:
Design, implement, and maintain robust data pipelines that cover the entire data lifecycle, from data ingestion to data loading, and ensure the efficient flow of data through the entire process. - Data Ingestion
:
Develop and manage data ingestion processes to collect data from different sources, such as databases, APIs, logs, and other data repositories, ensuring data is collected in a reliable and scalable manner. - Data Transformation
:
Perform data transformations and data enrichment to convert raw data into a structured and usable format, preparing it for storage and analysis. - Data Loading
:
Implement data loading procedures to efficiently store processed data into data warehouses, data lakes, or other storage systems, ensuring data quality and integrity. - Data Validation
:
Design and implement data validation mechanisms to verify data accuracy, consistency, and completeness, ensuring the data is reliable for analytical purposes. - Data Processing
:
Utilize various data processing technologies and frameworks to handle large‑scale data volumes efficiently and effectively. - Data Monitoring and Maintenance
:
Establish monitoring processes to ensure data pipelines run smoothly, and proactively address any issues that arise. Regularly maintain and optimize data pipelines for better performance and scalability. - Cloud Migration
:
Plan and execute cloud migration strategies, transferring data and applications to cloud‑based platforms while ensuring security, scalability, and cost‑efficiency. - Databricks Expertise
:
Leverage Databricks and Apache Spark to build scalable and high‑performance data processing workflows, providing insights and analytics on large datasets. - ETL and Data Ingestion Processes
:
Understand and implement ETL (Extract, Transform, Load) processes used in large‑scale data warehouses, ensuring efficient data movement and integration. - Data Governance and Security
:
Implement data governance best practices and security measures to protect sensitive data and ensure compliance with data privacy regulations.
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- Proven experience as a Data Engineer or similar role with a strong focus on data pipeline development.
- Expertise in creating end‑to‑end data pipelines, including data ingestion, extraction, transformation, loading, and validation.
- Proficiency in cloud migration, particularly with cloud platforms like AWS, Azure, or Google Cloud.
- Experience with Databricks and Apache Spark for large‑scale data processing and analytics.
- In‑depth…
Position Requirements
10+ Years work experienceTo View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction