Expert Software Engineer, Data Platform

Overview

Senior Software Engineer focused on designing, building, and scaling a next-generation Data Platform and data-driven APIs for real-time data access.

What you'll do

• Design and develop scalable batch and streaming data pipelines using Apache Spark.
• Build and maintain data platform layers including ingestion, transformation, and serving.
• Optimize Spark jobs for performance, cost, and reliability.
• Implement data quality, observability, and lineage frameworks.
• Design and build platform APIs and Java-based services that expose curated datasets.
• Integrate upstream and downstream systems, including legacy APIs, for real-time and near real-time access.
• Use CI/CD, unit tests, and code reviews to ensure engineering excellence across data and services.

What you'll need

• 4+ years of software engineering experience with focus on data platforms and/or distributed systems.
• Hands-on expertise in Apache Spark or Scala or PySpark.
• Strong programming skills in Java (preferred) / Scala / Python.
• Experience building large-scale data pipelines (ETL/ELT).
• Experience developing backend services or APIs (REST/microservices).
• Deep understanding of distributed systems, data storage formats, and data modeling/schema evolution.

Details

• Location: Bangalore, India.
• Reports to: Development Manager.