Senior Data Platform Engineer, Data Cloud

Overview

The engineering team at Chainalysis is solving the hardest technical challenges and building products that build trust in cryptocurrencies. We’re a global organization with teams in the UK, Denmark, Canada, and the USA and we focus on a flexible platform that adapts to rapid changes in the industry.

We’re looking for a Senior Data Platform Engineer to join our Data Cloud team. This group accelerates innovation and helps unlock new business lines by enabling anyone at Chainalysis to discover, access, analyze, and build on top of data. You’ll lead the creation and optimization of petabyte-scale data storage, data processing, and data querying platforms. If you’re passionate about high-performance interactive analytics, real-time streaming data applications, and deploying cloud infrastructure at scale with enterprise-grade reliability, we want you on our team!

In this role, you’ll:

• Help define the technical vision of the team/org, articulate how our data platform and architecture could evolve

• Design, implement, and optimize our high-performance, scalable data serving platform that enables data querying and consumption across the organization and external facing data products

• Design, implement, and optimize our high-performance, scalable data storage and transformation platform that enables both batch and stream processing with 100+ million updates per day on datasets > 100 billion rows

• Build seamless integrations between Data Cloud and various relational and noSQL OLTP databases

• Build batch and streaming data pipelines for core blockchain datasets widely used across the company

• Deploy cloud infrastructure at scale with enterprise-grade reliability, implement and maintain infrastructure automation and self-service, and create robust CI/CD pipelines

• Establish and maintain observability, security, and data governance solutions to ensure high quality, efficiency, and reliability of data pipelines

We’re looking for candidates who have:

• 6+ years of experience as a Data Platform Engineer or Data Engineer or Data Infrastructure Engineer, with hands-on expertise in building and maintaining cloud-based data platforms at large scale

• Passion for leading/contributing towards the technical vision of the team/org, strong ownership of mission critical systems, dedication to honing their craft while mentoring others

• Experience in building and maintaining both batch and streaming data pipelines using DBT/Databricks/Apache Spark/Apache Flink, as well as deep understanding of data architecture and data modeling best practices

• Expertise with AWS services, cloud architecture, fault-tolerant distributed data systems, and proficiency with Terraform for provisioning and managing cloud infrastructure

• Deep understanding of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake, DBT, Airflow, Debezium, Delta/Iceberg, Star Rocks, Clickhouse, and proficiency with Python/Java and SQL

• Experience building tools and frameworks to accelerate the development of data pipelines, and familiarity with data governance, data quality, and observability best practices

Nice to have

Experience:

• Exposure to or interest in the cryptocurrency technology ecosystem

• Experience working with different blockchain technologies is a plus

Technologies we use:

• Data Lakehouse:
  Kafka, Flink, Spark, Databricks, DBT, Debezium, Star Rocks/Clickhouse

• AWS Services: MSK, EC2, VPC, IAM, S3, SQS, Managed Flink, EKS, etc.

About Chainalysis

Blockchain technology is powering a growing wave of innovation. Businesses and governments around the world are using blockchains to make banking more efficient, connect with their customers, and investigate criminal cases. As adoption of blockchain technology grows, more and more organizations seek access to all this ecosystem has to offer. That’s where Chainalysis comes in. We provide complete knowledge of what’s happening on blockchains through our data, services, and solutions.

With Chainalysis, organizations can navigate blockchains safely and with confidence.

You belong here.

At Chainalysis, we believe that diversity of experience and thought makes us stronger. With both customers and employees around the world, we are committed to ensuring our team reflects the unique communities around us. We’re ensuring we keep learning by committing to continually revisit and reevaluate our diversity culture. We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more.

If you need any accommodations to make our interview process more accessible, please let us know. We can’t wait to meet you.