Staff Hadoop Software Engineer

Overview

Staff Hadoop Software Engineer responsible for architecting and scaling distributed Hadoop and open-source data platforms, plus delivering high-performance infrastructure and tooling.

What you'll do

• Architect scalable, highly available Hadoop and open-source data platforms.
• Lead technical execution of distributed data-processing pipelines and platform frameworks.
• Optimize resource utilization, throughput, and performance reliability.
• Design tools for data access, governance, and cluster management.
• Integrate Hadoop data layers with enterprise platforms and automate workflows.

What you'll need

• 10+ years of software design and distributed-systems development experience.
• Expertise in Java and/or Scala.
• Strong knowledge of algorithms, concurrency models, and data structures.
• Mastery of Linux/Unix internals, network topologies, and distributed computing.
• Hands-on expertise with Hadoop, Spark, Apache Iceberg, and Apache YuniKorn.
• Experience in root-cause analysis, memory profiling, and performance tuning.
• History of shipping complex infrastructure products in enterprise environments.

Nice to have

• Open-source project contributions or upstream community engagement.

Details

• Location: Bengaluru, India.