Overview
Lead GCP Data Engineer role focused on building reliable, scalable data pipelines and migrating on-prem data pipelines to the GCP stack.
What you'll do
- Design, build and deploy internal applications to support the technology life cycle, collaboration and spaces, service delivery management, and data and business intelligence.
- Build modular code for multi-usable pipelines or complex ingestion frameworks that load data into a Datalake or Data Warehouse from multiple sources.
- Create custom-built pipelines and migrate on-prem data pipelines to the GCP stack.
- Work closely with analysts and business process owners to translate business requirements into technical solutions.
- Maintain the highest levels of development practices, including technical design, solution development, systems configuration, test documentation and execution, issue identification and resolution, and writing clean, modular and self-sustaining code.
What you'll need
- Experience in software development, data engineering, business intelligence, or a related field, with experience manipulating, processing, and extracting value from datasets.
- Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience.
- Coding experience in scripting and languages (Python, SQL, PySpark).
- Expertise in Google Cloud Platform (GCP) technologies in the data warehousing space (BigQuery, GCP Workflows, Cloud Scheduler, Secret Manager, Batch, Cloud Logging, Cloud SDK, Google Cloud Storage, IAM).
- Understanding of CI/CD processes using Pulumi, GitHub, Cloud Build, Cloud SDK, and Docker.
- Excellent verbal and written communication skills, with the ability to effectively advocate technical solutions to engineering teams and business audiences.
Nice to have
- Exposure to Google Dataproc and Dataflow.
- 5+ years of GCP Certified Data Engineer experience.
- Coding experience in scripting and languages (Python, SQL, PySpark).
- Work closely with analysts and business process owners to translate business requirements into technical solutions.
Details
- Location: Noida, India (hybrid), working from the Noida/Bengaluru office 1 to 2 times per week.
- Willingness to work the afternoon shift from 3 PM to 12 AM IST.
Read the full description and apply on the company’s own careers page.