Lead Data Engineer - GCP

Overview

Lead/ Senior GCP Data Engineer role focused on building scalable data engineering solutions on Google Cloud Platform (GCP).

What you'll do

• Design and develop scalable, reliable data pipelines using GCP services.
• Develop data processing and transformation solutions using Python and SQL.
• Build and optimize ETL/ELT pipelines for large-volume datasets.
• Work with business and technical teams to understand data requirements and deliver solutions.
• Perform data modeling, data validation, and performance optimization.
• Monitor, troubleshoot, and resolve data pipeline production issues.
• Implement data quality, security, and governance best practices.
• Participate in code reviews and technical design/architecture discussions.

What you'll need

• 6+ years of experience in data engineering.
• Strong hands-on experience with GCP.
• Strong programming experience in Python.
• Strong expertise in SQL (complex queries, joins, CTEs, window functions, query optimization).
• Experience developing ETL/ELT data pipelines.
• Hands-on experience with one or more GCP services (BigQuery, GCS, Cloud Composer/Airflow, Dataflow, Pub/Sub, Dataproc).
• Experience with Git and CI/CD practices.

Nice to have

• Experience with Apache Spark/PySpark.
• Terraform or Infrastructure as Code.
• Exposure to GCP Dataform.
• Experience with real-time/streaming data pipelines.
• Knowledge of cloud security and IAM.
• Experience working in Agile environments.

Details

• Location: Hyderabad, TS, India.