Distinguished Engineer - Data Architect

Overview

Distinguished Engineer – Data Architect to design and build the data foundation for an AI-driven security platform, including the architectural blueprint and core implementation.

What you'll do

• Design, implement, and evolve a unified blueprint for streaming and batch data processing.
• Build systems to ingest, normalize, and store petabyte-scale, high-velocity security telemetry.
• Architect storage, retrieval, and feature stores for low-latency AI inference and training.
• Set up vector database structures and data lakehouse layers for ML-ready data fabrics.
• Enforce multi-tenant isolation, data privacy guardrails, and compliance controls in the data fabric.
• Optimize infrastructure cost-efficiency and performance tuning across data processing and storage layers.
• Write clean, foundational, high-performance code for critical infrastructure components.

What you'll need

• 12+ years of data engineering and architecture experience.
• Experience designing production systems for massive, high-throughput streaming datasets.
• Deep expertise in distributed processing and streaming engines (Apache Flink, Spark, Kafka, Pulsar).
• Knowledge of lakehouse architectures (Iceberg, Delta Lake).
• Mastery of polyglot persistence including relational, NoSQL, columnar (ClickHouse, DuckDB), and vector databases (Milvus, Qdrant, Pinecone).
• Strong secure data architecture fundamentals including encryption at rest/in transit and Kubernetes.
• Cloud-native infrastructure knowledge for AWS/GCP/Azure.

Details

• Location: Pune, Maharashtra, India.
• Work mode: Hybrid (as indicated by #LI-Hybrid).
• Employment type: null.