More jobs:
Senior Data Engineer – Spark/Scala
Job in
Richmond, Henrico County, Virginia, 23214, USA
Listed on 2026-09-27
Listing for:
Astyra Corporation
Full Time
position Listed on 2026-09-27
Job specializations:
-
Software Development
Data Engineering, SQL Developer
Job Description & How to Apply Below
Astyra’s client is seeking a hands-on Senior Data Engineer to support a large-scale data and technology modernization initiative. This position will focus on modernizing legacy ETL workloads, developing Spark-based data pipelines, and ensuring data accuracy and consistency as workloads transition to modern platforms.
The ideal candidate has deep hands-on experience with Spark and Scala and a strong background designing, building, optimizing, and validating enterprise data pipelines.
- Design, build, and maintain scalable data pipelines using Spark and Scala
- Support the migration of legacy ETL workloads into a modern Spark-based data framework
- Develop and enhance data transformation and processing solutions
- Perform data comparison, reconciliation, and validation between legacy and target platforms
- Identify and troubleshoot data discrepancies throughout the migration process
- Develop data quality checks and controls to ensure completeness and accuracy
- Optimize Spark jobs and pipelines for performance, scalability, and reliability
- Work closely with data engineers, architects, and other technical teams throughout the modernization effort
- Support testing, deployment, troubleshooting, and ongoing maintenance of production data pipelines
- Contribute to broader feature engineering and data modernization initiatives
- 7+ years of experience in data engineering or a related technical discipline
- Strong hands-on experience designing and developing enterprise data pipelines
- Advanced experience with Apache Spark
- Strong development experience with Scala
- Experience with ETL development, modernization, and migration initiatives
- Strong understanding of data transformation, data quality, and reconciliation
- Experience comparing and validating data across legacy and modernized systems
- Experience developing and supporting production data-processing workloads
- Familiarity with modern CI/CD and software development practices
- Strong troubleshooting and problem-solving skills
- Experience migrating legacy ETL platforms to Spark-based architectures
- Experience supporting large-scale technology or data modernization initiatives
- Experience with in financial services or other highly regulated environments
- Python experience
- Exposure to Generative AI or AI-assisted development and modernization tools
- Previous experience within a large enterprise engineering environment
Position Requirements
10+ Years
work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×