Data Engineer

Overview

Data Engineer on the Unified Integration Platform (UIP) team, PayPal's enterprise data replication team, which replicates data at scale between data stores across PayPal and between PayPal and external partners.

What you'll do

• Design and develop data pipelines for efficient data collection and processing.
• Build and maintain scalable data storage solutions.
• Ensure data quality and consistency through validation and cleansing processes.
• Implement data transformation techniques to prepare data for analysis.
• Collaborate with cross-functional teams to understand data requirements and provide solutions.
• Optimize data engineering processes for performance and reliability.
• Design, build, and maintain batch and streaming replication pipelines that move high volumes of data between on-prem and cloud data stores.
• Tune pipelines for throughput, latency, and cost.
• Handle schema changes, backfills, and failure recovery without data loss or duplication.
• Build data quality checks, reconciliation, monitoring, and alerting.
• Onboard new sources and targets with product, platform, and consuming teams.
• Join design reviews, code reviews, on-call, and root-cause analysis.

What you'll need

• 1+ years relevant experience and a Bachelor's degree OR any equivalent combination of education and experience.
• 2–4 years of experience in data engineering or backend software engineering.
• Strong programming skills in Java, Python, or Scala, and strong SQL.
• Hands-on experience with distributed data processing and streaming (Kafka, Spark, Dataflow, or similar).
• Familiarity with relational and NoSQL databases, change data capture (CDC), and cloud platforms (GCP preferred).
• Understanding of data modelling, pipeline design, and performance tuning for high-volume systems.
• Strong debugging skills and a sense of ownership of your work end to end.
• Clear communication and a collaborative approach.
• Bachelor's degree in computer science, Engineering, or a related field, or equivalent experience.

Details

• Location: Bangalore, Karnataka, India.
• Hybrid work model: 3 days in the office and 2 days at your choice of PayPal office or home workspace.