Sr. Data Engineer - Data Engineering 4B

Overview

Sr. Data Engineer focused on building and maintaining real-time streaming data processing applications using Apache Flink and the Kafka ecosystem.

What you'll do

• Design, develop, and maintain high-performance real-time data processing applications using Apache Flink.
• Leverage Flink with Kafka Streams, KSQLDB, and Kafka SMTs for in-flight transformation logic.
• Implement complex event processing, enrichment, filtering, aggregation, and windowing for streaming workloads.
• Optimize streaming pipeline performance for low latency and high throughput.
• Handle late-arriving and out-of-order events using event-time processing, watermarks, checkpointing, and state management.
• Integrate streaming applications with Kafka, Schema Registry, APIs, and downstream analytical platforms.
• Implement error handling, retry mechanisms, DLQ, and monitoring; troubleshoot production streaming jobs.

What you'll need

• 6–10+ years of experience in Data Engineering with real-time streaming solutions.
• Hands-on Apache Flink experience for enterprise-scale stream processing.
• Strong knowledge of Apache Kafka, Kafka Streams, KSQLDB, Kafka Connect, and Kafka SMTs.
• Strong understanding of event-time processing, watermarks, windowing, checkpointing, stateful stream processing, and fault tolerance.
• Proficiency in Java and/or Scala; Python knowledge is desirable.
• Strong SQL skills for large-scale structured and semi-structured datasets.
• Experience with Avro, Protobuf, JSON, Schema Registry, and serialization techniques.

Details

• Location: Noida, Uttar Pradesh, India.
• Work mode: Remote (Flex Time in India).
• Employment type: Regular.