Senior Software Engineer - Data Platform

Overview

Senior Software Engineer - Data Platform, focused on designing and optimizing a modernized Big Data Platform and its pipelines.

What you'll do

• Architect platform components for the Big Data Platform.
• Optimize existing Big Data systems and pipelines.
• Develop and implement cost-effective new systems and pipelines.
• Make changes to underlying systems and contribute work back to open source.
• Support internal customers and on-call services for hosted systems.
• Ensure systems run efficiently and provide a stable environment and user experience.

What you'll need

• 12+ years of production experience building big data platforms using Spark, Trino, or equivalent.
• Strong software fundamentals and programming expertise in Java, Scala, Kotlin, or another JVM language.
• Strong distributed systems concepts, algorithms, and data structures knowledge.
• Experience modifying or extending internals of at least 3 listed technologies (e.g., Spark, Trino, Presto, Flink, Airflow, Druid, Hive, Hadoop, HBase, Iceberg, Delta Lake, Pinot, Storm, Kafka, Pulsar, ClickHouse).
• Strong familiarity with the Apache Hadoop ecosystem and deep expertise in distributed processing/query engine internals.
• Proven experience diagnosing performance bottlenecks and tuning distributed engines to maximize throughput and minimize operational costs.
• Extensive hands-on experience with AWS or GCP.
• Production-grade Agentic AI development experience.
• A Bachelor's or Master's degree in computer science or equivalent.

Details

• Location: Bengaluru, India.
• Hybrid working: teams generally work in the office Monday through Thursday; Fridays are generally flexible for remote work with role/office exceptions.