Software Engineering Manager, Data Platform

Overview

Software Engineering Manager for the Data Platform, leading a batch processing platform team.

What you'll do

• Lead, mentor, and grow engineers building batch processing and data platform capabilities.
• Drive roadmap execution focused on reliability, scalability, ease of use, and time-to-data.
• Design and evolve a scalable batch processing platform using Apache Spark (PySpark) and distributed compute.
• Implement workflow orchestration with tools such as Airflow or Temporal.
• Ensure governance, security, and compliance through platform guardrails and self-service controls.
• Provide end-to-end observability including metrics, logging, alerting, and SLA tracking.
• Partner across teams and influence architecture decisions while communicating with senior stakeholders.

What you'll need

• 8–12+ years in software or data engineering.
• 3–5+ years managing engineering teams.
• Experience with distributed data processing (e.g., Spark, Flink) and batch pipelines at scale.
• Hands-on understanding of AWS (preferred).
• Deep understanding of data lake/lakehouse architectures and workflow orchestration (e.g., Airflow, Temporal).
• Proven ability to hire, mentor, and grow high-performing teams.
• Strong communication and cross-functional influence skills.

Nice to have

• Experience with Apache Iceberg or Delta Lake.
• Familiarity with data observability tools.
• Exposure to data governance frameworks and compliance standards.

Details

• Location: Bengaluru, India.