Data Engineer

Overview

Data Engineer focused on building, deploying, and maintaining scalable data pipelines on GCP with an emphasis on ETL/ELT, performance, and reliable data operations.

What you'll do

• Develop, deploy, and maintain ETL/ELT pipelines in GCP using Cloud Composer and PySpark on Dataproc.
• Optimize performance using BigQuery features like partitioning, clustering, and materialized views.
• Support implementation of BigLake components for unified governance across structured and unstructured data.
• Deploy and manage pipeline code and infrastructure using Terraform and CircleCI.
• Implement logging, alerting, and data quality checks for monitoring and reliability.
• Collaborate with senior and cross-functional teams to translate business requirements into data solutions.
• Continuously learn new GCP services and tools to improve data processing capabilities.

What you'll need

• 2–4 years of hands-on data engineering experience.
• Solid knowledge of GCP services including BigQuery, Dataform, Cloud Composer, Cloud Storage, Cloud Functions, and Dataproc.
• Proficiency in Dataform for version-controlled SQL workflows and BigQuery modeling.
• Strong Python and SQL skills with modular, testable code.
• Solid data modeling knowledge including star schema and snowflake, plus data operations understanding.
• Experience with CI/CD tools and Infrastructure-as-Code.

Details

• Location: Bangalore.