Senior Associate – AWS Data Engineer – Data and Analytics – Advisory

Overview

Senior Associate AWS Data Engineer (Data & Analytics – Advisory) responsible for designing and building scalable data ingestion and ETL/ELT pipelines on AWS.

What you'll do

• Develop ETL/ELT pipelines using AWS services such as Glue, Step Functions, Lambda, and DMS.
• Implement direct-to-Aurora ingestion strategies for snapshots and delta loads.
• Ensure referential integrity, correct processing order, idempotency, and recovery mechanisms.
• Build monitoring, validation, and reconciliation frameworks for production data pipelines.
• Manage scalability and throughput during high-volume EOD ingestion workloads.

What you'll need

• 5–8 years of experience is required.
• Strong expertise in SQL, Python, and PySpark.
• Hands-on experience with ETL pipelines and orchestration frameworks.
• Solid understanding of ACID-compliant data ingestion principles.
• Experience with schema evolution and CDC (Change Data Capture) patterns.
• Experience owning production readiness and end-to-end solution delivery.
• Exposure to AWS tools including Glue, Step Functions, Lambda, and DMS.

Nice to have

• Experience with SAP ODP or enterprise data replication technologies.
• Familiarity with distributed PostgreSQL systems.
• Exposure to event-driven architectures such as Kafka.

Details

• Location: Bengaluru Millenia.