Senior Data Engineer (Python/ Spark/GCP)

Overview

Senior Data Engineer to build and modernize scalable data platforms on GCP and enable AI/GenAI-driven data solutions.

What you'll do

• Lead initiatives related to large-scale data processing framework work.
• Build and maintain optimized, highly available data pipelines for analysis and reporting.
• Oversee data integration including developing a data model and maintaining data warehouse/analytics environments.
• Resolve moderately complex data engineering issues and lead teams to deliver data engineering outcomes.
• Design and optimize scalable data pipelines using Python, SQL, Spark, and GCP services.
• Develop batch and streaming solutions using BigQuery, Dataproc, Cloud Composer, Kafka, and Pub/Sub.

What you'll need

• 4+ years of Data Engineering experience or equivalent (work experience, training, military experience, education).
• Strong experience in Python, SQL, and Spark.
• Hands-on experience with GCP services including BigQuery, Dataproc, Composer, and Pub/Sub.
• Experience building enterprise-scale ETL/ELT and streaming solutions.
• Understanding of data modeling, governance, and cloud architecture.
• Experience with REST APIs, Git, and CI/CD practices.

Details

• Location: Hyderabad, India.