More jobs:
Lead PySpark Engineer
Job in
London, Greater London, W1B, England, UK
Listed on 2026-02-18
Listing for:
SKILLFINDER INTERNATIONAL
Full Time
position Listed on 2026-02-18
Job specializations:
-
IT/Tech
Data Engineer, Cloud Computing, AWS
Job Description & How to Apply Below
Key Responsibilities Technical Delivery Design, develop, and maintain complex PySpark solutions for ETL/ELT and data mart workloads. Convert and refactor Legacy SAS code into optimized PySpark solutions using automated tooling and manual refactoring techniques. Build scalable, maintainable, and production-ready data pipelines. Modernize Legacy data workflows into cloud-native architectures. Ensure data accuracy, quality, integrity, and reliability across transformation processes. Cloud & Data Engineering (AWS-Focused) Develop and deploy data pipelines using AWS services such as EMR, Glue, S3, and Athena.
Optimize Spark workloads for performance, scalability, partitioning strategy, and cost efficiency. Implement CI/CD pipelines and Git-based version control for automated deployment. Collaborate with architects, engineers, and business stakeholders to deliver high-quality cloud data solutions. Core Technical Skills PySpark & Data Engineering 5+ years of hands-on PySpark experience (Advanced level).
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×