Custom Software Engineer

Overview

Custom Software Engineer role focused on designing and building GCP-based applications and data pipelines.

What you'll do

• Design and implement robust batch and streaming data pipelines using Python and GCP services.
• Build and maintain data transformation workflows using Dataform (SQLX) integrated with BigQuery.
• Develop event-driven and real-time processing solutions using Pub/Sub and Cloud Functions/Cloud Run.
• Manage large-scale data across GCS, BigQuery, and Cloud Spanner.
• Provision and manage GCP infrastructure using Terraform (IaC).
• Maintain CI/CD pipelines in GitLab for automated testing, linting, and deployment.
• Write and unit test clean Python code using GCP client libraries and pytest.

What you'll need

• Minimum 3 years of experience in Google Cloud Platform Architecture.
• Good experience in Google Cloud Platform Architecture.
• 5+ years of data engineering experience with at least 2 years on GCP.
• Strong Python skills for clean code, OOP, packaging, and performance optimization.
• Hands-on BigQuery experience including query optimization, partitioning, clustering, and data modelling.
• Experience with Pub/Sub for event-driven architectures and streaming ingestion.
• Unit testing experience with pytest, including mocking and fixtures.

Details

• Based at Bengaluru office.
• Location listed as: Location Negotiable, Bengaluru.