Director of Engineering

Overview

Engineering Director leading the design and delivery of an AI-enabled data ingestion platform on AWS, covering batch and real-time streaming pipelines.

What you’ll do

• Own end-to-end architecture for batch and streaming data ingestion, from onboarding to serving.
• Design scalable data models and schemas for a modern lakehouse.
• Build high-throughput, fault-tolerant distributed pipelines with idempotency, replay, and backfill.
• Architect real-time ingestion and CDC using Kafka/MSK/Kinesis and streaming frameworks.
• Embed data quality, lineage, validation, and control frameworks into ingestion and enforce data contracts.
• Implement observability with freshness/latency tracking and SLOs/SLIs plus error budgets.
• Lead strategy and engineering delivery, mentoring teams across data, platform/DevOps, and AI/ML.

What you’ll need

• 12+ years in software/data engineering.
• 5+ years in engineering leadership roles.
• Deep expertise designing and operating large-scale batch and streaming data pipelines in production.
• Experience with distributed processing including Apache Spark (EMR/Glue) and Flink or Beam.
• Expert-level SQL and Python (Scala/Java).
• Proven AWS data platform expertise including S3, Glue, EMR, Lambda, MSK/Kinesis, and related services.

Details

• Hybrid based in Hyderabad and reporting to the CTO.