Senior Data Engineer, Data Platform
Listed on 2025-12-15
-
IT/Tech
Data Engineer, Big Data, Data Scientist, Data Analyst
Your work will change lives. Including your own.
Recursion is a leading, clinical-stage Tech Bio company decoding biology to industrialize drug discovery.Central to its mission is the Recursion Operating System (OS), a platform built across diverse technologies that continuously expands one of the world’s largest proprietary biological, chemical and patient-centric datasets.
Recursion leverages sophisticated machine-learning algorithms to distill from its dataset a collection of trillions of searchable relationships across biology and chemistry unconstrained by human bias.
By commanding massive experimental scale—up to millions of wet lab experiments weekly—and massive computational scale—owning and operating one of the most powerful supercomputers in the world—Recursion is uniting technology, biology, chemistry and patient-centric data to advance the future of medicine.
In this role, you will:- Build, scale, and operate a data platform
. You will be a member of the platform team responsible for building, operating, and tuning a data platform that allows users to discover and query across the breadth of our data at Recursion, which includes a chemistry library of billions compounds, petabytes of cellular microscopy images taken in millions of different experimental contexts, and millions of assay results, all supporting Recursion’s drug discovery. - Build relatability into a heterogeneous dataset. At Recursion, we generate datasets based on a wide swath of diverse biological models and treatment approaches. You'll work with biologists, chemists, and data scientists to build relatability and query-ability into these datasets so they can be used in the future to answer the sorts of questions we haven't even thought of asking yet.
- Act as a mentor, coach, and sponsor. You will share your technical knowledge and experiences, delivering impact, learning, and growth across teams at Recursion.
- You will join the Data Lake team that built and maintains our Data Lake/house. The team is responsible for relational and object storage and has the motto:
all data flows to the Data Lake
. The team solves the problem of making our diverse data discoverable, queryable, and relatable across datasets while we continue to add new data modalities as we grow. This will require collaboration with many different groups including teams building out reports, dashboards, and applications, teams finding and generating the required data for machine learning problems, and teams building and iterating on new data processing pipelines.
Experience You’ll Need
- 5+ years of deep experience in modern, cloud-based data engineering tools to build data platforms that enable the discovery, query, and processing of large datasets.
- Up to date on industry trends and tools. You understand the tradeoffs between different data platform architectures and technologies like a data lake, a data warehouse and can draw on this knowledge to develop data platforms solutions for Recursion.
- Excitement to learn parts of our tech stack that you might not already know. Our current tech stack includes:
Python, dbt, Prefect, Big Query, Data stream, Five Tran, Postgre
SQL, GCS, Kubernetes, CI/CD, Infrastructure as Code. Our cloud services are provided by Google Cloud Platform. - Experience working collaboratively on projects with significant ambiguity and technical complexity, ideally spanning multiple systems and involving diverse technologies.
- A people-first mindset. Despite the deadlines, we always prioritize supporting our coworkers in their growth and experience.
- A drive to deliver technical solutions that are easily monitored and understood as they run in production and the effects of change can be readily quantified.
- A drug discovery, biology or chemistry background is not necessary, but intellectual curiosity is a must!
This position can be based at either our London or Milton Park office
. Please note that we are a hybrid environment and ask that employees spend 50% of their time in the office.
At Recursion, we believe that every employee should be compensated fairly. Based on the skill and level of experience…
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search: