Senior Data Engineer

Overview

Design, build and run the data systems behind Merkle Science's blockchain transaction monitoring products, covering ingestion, processing, analytical storage and serving, with ownership from design document through to production.

What you'll do

• Design and build scalable, high-throughput data pipelines and platform systems for blockchain data across 30+ chains.
• Build backend data services and loaders in Go and Python.
• Design and evolve data models and analytical workloads in ClickHouse, and tune them for sub-second queries.
• Build incremental, idempotent pipelines on Databricks over billions of rows and tens of terabytes.
• Keep improving the scale, reliability, freshness, performance and cost efficiency of the platform.
• Investigate hard performance and reliability problems and see them through to resolution.
• Work closely with the product, analytics and investigations teams that use the data, and turn their needs into platform designs.
• Help set technical direction through architecture discussions, design reviews and code reviews.
• Mentor engineers and help set strong engineering and operational practices.

Details

• Location: Bangalore.