Senior Algorithm Engineer; Python/Spark–Distributed Processing
Job in
Grimsby, Lincolnshire, DN32, England, UK
Listed on 2026-01-29
Listing for:
Xcede
Full Time
position Listed on 2026-01-29
Job specializations:
-
IT/Tech
Data Engineer, Data Science Manager, Machine Learning/ ML Engineer, AI Engineer
Job Description & How to Apply Below
Overview
Senior Algorithm Engineer (Python / Spark – Distributed Data Processing)
Location:
UK (O/IR35) / Belgium / Netherlands / Germany (B2B)
Working model:
Remote
Start: ASAP
We’re hiring a Senior Algorithm Engineer to join a data-intensive SaaS platform operating in a complex, regulated industry. This is a hands-on senior IC role focused on building and optimising distributed data pipelines that power pricing, forecasting and billing calculations at scale.
This is not an ML / Data Science / GenAI role
What you’ll be doing- Design, build and deploy algorithms/data models supporting pricing, forecasting and optimisation use cases in production
- Develop and optimise distributed Spark / PySpark batch pipelines for large-scale data processing
- Write production-grade Python workflows implementing complex, explainable business logic
- Work with Databricks for job execution, orchestration and optimisation
- Improve pipeline performance, reliability and cost efficiency across high-volume workloads
- Collaborate with engineers and domain specialists to translate requirements into scalable solutions
- Provide senior-level ownership through technical leadership, mentoring and best-practice guidance
- Proven experience delivering production algorithms/data models (forecasting, pricing, optimisation or similar)
- Strong Python proficiency and modern data stack exposure (SQL, Pandas/Num Py + PySpark; Dask/Polars/DuckDB a bonus)
- Build, schedule and optimise Spark/PySpark pipelines in Databricks (Jobs/workflows, performance tuning, production delivery)
- Hands-on experience with distributed systems and scalable data processing (Spark essential)
- Experience working with large-scale/high-frequency datasets (IoT/telemetry, smart meter, weather, time-series)
- Clear communicator able to influence design decisions, align stakeholders and operate autonomously
- Energy/utilities domain exposure
- Cloud ownership experience (AWS preferred, Azure also relevant)
- Experience defining microservices / modular components supporting data products
Position Requirements
10+ Years
work experience
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×