Data Architect - Data Engineering 4D

Overview

Data Architect focused on Data Engineering for real-time streaming applications, transformations, and enterprise data harmonization.

What you'll do

• Design, develop, and maintain real-time data processing applications using Apache Flink.
• Develop transformation logic using Apache Flink, Kafka Streams, KSQLDB, and Kafka SMTs.
• Implement scalable mapping frameworks to transform source data into harmonized enterprise data models.
• Build streaming event processing including enrichment, filtering, aggregation, and windowing.
• Integrate streaming applications with Kafka, Schema Registry, APIs, and downstream analytical platforms.
• Implement error handling, retries, DLQ, monitoring, and troubleshoot production streaming jobs.

What you'll need

• 6–10+ years of experience in Data Engineering for real-time streaming solutions.
• Hands-on experience with Apache Flink for enterprise-scale stream processing.
• Strong knowledge of Apache Kafka, Kafka Streams, KSQLDB, Kafka Connect, and SMTs.
• Strong understanding of event-time processing, watermarks, windowing, checkpointing, and stateful processing.
• Proficiency in Java and/or Scala; Python knowledge is desirable.
• Strong SQL skills for large-scale structured and semi-structured datasets.
• Experience with Avro, Protobuf, JSON, Schema Registry, and serialization techniques.

Details

• Remote type: Remote (Flex Time in India).
• Location (ATS): Bangalore, India.