Senior Data Engineer – Big Data & Streaming Platforms - Java/Scala or Python | Spark, Kafka | Flink, Iceberg / Lakehouse, Trino | 8 to 12 Years

Overview

Senior Data Engineer to build and operate a big data platform and streaming/data pipelines for Webex Data Analytics.

What you'll do

• Enhance big data-related open-source technologies.
• Build and operate Kafka-based streaming applications for ingestion, filtering, enrichment, and replication.
• Develop data processing jobs using Apache Spark and/or Apache Flink.
• Use Apache Iceberg to manage large analytical datasets.
• Tune jobs for performance, scalability, and cost efficiency.
• Write clean, testable code and participate in code reviews.

What you'll need

• Have 8 to 12 years of experience in data engineering and software development.
• Work with the open-source ecosystem.
• Write high-quality code in Java/Scala, Python, or equivalent languages.
• Have practical experience with Apache Spark and Apache Flink.
• Have practical experience with query engines like Trino/Presto.
• Have experience with Kafka and scaling for high volume workloads.
• Have strong SQL skills and understanding of data modeling for analytical workloads.

Details

• Location: Bangalore, India.