Principal Data Engineer

Overview

Principal Data Engineer responsible for end-to-end delivery of enterprise-scale data solutions on Google Cloud Platform, including architecture, governance, and technical leadership across data engineering and AI initiatives.

What you'll do

• Architect and evolve cloud-native, petabyte-scale data platforms and data products with defined SLOs for freshness, availability, and reliability.
• Design scalable data solutions balancing scalability, performance, cost, and operational excellence via architectural trade-offs.
• Establish reference architectures, guardrails, and organization-wide engineering standards.
• Lead adoption of domain-oriented data architecture patterns (e.g., data mesh principles).
• Own end-to-end delivery of complex data engineering initiatives including real-time streaming and unified batch-streaming pipelines.
• Architect automated data quality, lineage tracking, and enterprise metadata management systems.
• Serve as technical advisor—mentoring teams and partnering with stakeholders to translate objectives into scalable solutions.

What you'll need

• 8+ years hands-on Google Cloud Platform experience, including deep expertise in BigQuery.
• 15+ years data engineering experience and 8+ years specifically on Google Cloud Platform.
• Expert-level Python/Java with proficiency in Python/Scala for Spark development.
• Deep expertise in Apache Beam, Apache Spark, Airflow, Kafka, and distributed computing architectures.
• Extensive experience with Terraform and CI/CD pipelines for cloud infrastructure management.
• Advanced knowledge of relational (PostgreSQL, MySQL) and NoSQL systems (BigTable, Firestore, MongoDB) plus data modeling and optimization.
• Experience with MLOps, feature engineering platforms, model serving infrastructure, and integrating LLM capabilities into production pipelines.

Details

• Location: Bangalore Office BLS2.