Senior Data Engineer

Overview

Design, build and run the data systems behind Merkle Science's blockchain transaction monitoring and intelligence products, covering ingestion, processing, analytical storage and serving.

What you'll do

• Design and build scalable, high-throughput data pipelines and platform systems for blockchain data across 30+ chains.
• Build backend data services and loaders in Go and Python.
• Design and evolve data models and analytical workloads in ClickHouse, and tune them for sub-second queries.
• Build incremental, idempotent pipelines on Databricks over billions of rows and tens of terabytes.
• Keep improving the scale, reliability, freshness, performance and cost efficiency of the platform.
• Investigate hard performance and reliability problems and see them through to resolution.
• Work closely with the product, analytics and investigations teams that use the data, and turn their needs into platform designs.
• Help set technical direction through architecture discussions, design reviews and code reviews.
• Mentor engineers and help set strong engineering and operational practices.

Details

• Location: London.