C

GCP Data Engineer

Capco
Posted a month ago

LOCATION

Bengaluru · Onsite

EXPERIENCE

8 - 12 Years

SKILLS REQUIRED

Data EngineeringPythonStreaming Data PipelinesSQLPub/SubCloud StorageDataflowBigQueryCloud Composer

Job description

Overview

Design, build, and support distributed systems and large-scale data processing systems on Google Cloud. Lead feature teams and deliver batch and real-time data solutions for clients.

What you'll do

  • Design distributed systems and large-scale data processing systems for production.
  • Build batch data pipelines on Google Cloud.
  • Build streaming data pipelines on Google Cloud.
  • Write complex SQL queries and production code or scripts.
  • Work with real-time streaming technologies such as Kafka.
  • Lead feature teams to deliver outcomes and handle clients.

What you'll need

  • 8–12 years of hands-on GCP data engineering experience.
  • Expertise with BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Cloud Composer.
  • Strong coding or scripting skills in Python, SQL, Java, Scala, or Go.
  • Experience with operational data stores, data warehouses, big data technologies, and data lakes.
  • Experience with Spark, Flink, Beam, or Hadoop.
  • Knowledge of Docker, Kubernetes, and cloud platforms such as GCP, Azure, or AWS.
  • Experience with automation and CI/CD tools including Jenkins, GitHub, or Spinnaker.

Nice to have

  • GCP Cloud Architect, Cloud Developer, or Professional Data Engineer certification.
  • Apache Kafka certification (CCDAK).

Details

  • Locations: Bengaluru, Chennai, or Hyderabad, India.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

GCP Data Engineer