Data Engineering Manager - GCP

Overview

Senior GCP Data Engineer to design, build, and maintain scalable data engineering solutions on Google Cloud Platform.

What you'll do

• Design and develop scalable, reliable data pipelines using GCP services.
• Develop data processing and transformation solutions using Python and SQL.
• Build and optimize ETL/ELT pipelines for large-volume datasets.
• Monitor and troubleshoot data pipelines and resolve production issues.
• Perform data modeling, validation, and performance optimization.
• Implement data quality, security, and governance best practices.

What you'll need

• 6+ years of experience in data engineering.
• Hands-on experience with Google Cloud Platform (GCP).
• Strong hands-on programming experience in Python.
• Strong SQL expertise including complex queries, joins, CTEs, window functions, and query optimization.
• Experience developing ETL/ELT data pipelines.
• Experience with one or more GCP services such as BigQuery, Cloud Storage (GCS), Cloud Composer/Airflow, Dataflow, Pub/Sub, Dataproc.
• Experience with Git and CI/CD practices.

Nice to have

• Experience with Terraform or Infrastructure as Code.
• Exposure to GCP Dataform.
• Experience with real-time/streaming data pipelines.
• Knowledge of cloud security and IAM.
• Experience working in Agile environments.

Details

• Location: Hyderabad, TS, India.