Manager – Data Engineer GCP, Data and Analytics, Advisory

Overview

Manager-level Data Engineer role focused on designing, building, and operating scalable data pipelines on Google Cloud Platform.

What you'll do

• Design, build, and maintain end-to-end batch and streaming data pipelines on GCP.
• Develop scalable data processing solutions with BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
• Build and optimize Cloud Composer/Airflow DAGs for orchestration, scheduling, retries, and dependencies.
• Ingest, transform, and curate large-scale structured, semi-structured, and streaming datasets.
• Implement BigQuery performance and cost optimization (partitioning, clustering, tuning, data model improvements).
• Provide production support, troubleshoot pipeline failures, and resolve performance bottlenecks.

What you'll need

• 4+ years of experience as a Data Engineer with hands-on GCP expertise.
• Strong experience with BigQuery and SQL/data warehousing concepts.
• Hands-on experience with Dataflow and Apache Beam for batch and streaming pipelines.
• Experience with Dataproc and/or Spark/PySpark for distributed data processing.
• Experience with Cloud Composer/Airflow for orchestration and workflow management.
• Strong Python skills for reusable data engineering and automation.
• Understanding of IAM, service accounts, networking basics, and secure data access on GCP.

Details

• Location: Bengaluru Millenia.