Senior Associate – AWS Data Engineer, Advisory

Overview

Lead and perform hands-on development of scalable, cloud-native data engineering solutions, building and operating data pipelines on AWS for enterprise-scale data ingestion, migration and transformation.

What you'll do

• Lead and perform hands-on development of data engineering solutions, writing clean, efficient and maintainable code in Python, PySpark and other relevant programming languages.
• Design, develop and deploy cloud-native solutions on AWS, leveraging Compute services (EC2, Lambda) and Storage services (S3) to build scalable data platforms.
• Design and manage database solutions using RDS, Aurora, Postgres and DynamoDB to support structured and unstructured data workloads.
• Build and orchestrate data workflows using Apache Airflow, AWS Step Functions and SNS for reliable, automated pipeline execution.
• Develop and optimize ETL/analytics pipelines using AWS Glue, EMR, Athena and Redshift for large-scale data processing and analytics.
• Implement and manage infrastructure as code and deployment automation using AWS CloudFormation and CodePipeline.
• Plan and execute data migration strategies using AWS DataSync and AWS DMS, ensuring data integrity and minimal downtime.
• Integrate services using API Gateway and manage secure access controls through IAM.
• Handle large datasets and data models end-to-end, including data model design, data model creation, and development of data pipelines for ingestion, migration and transformation.
• Write, optimize and maintain SQL Server queries and stored procedures to support data processing and reporting needs.
• Collaborate with cross-functional teams, including architects, analysts and business stakeholders, to translate requirements into robust technical solutions.
• Ensure data pipelines and cloud infrastructure adhere to enterprise security, governance and compliance standards.

What you'll need

• 6–8 years of hands-on experience leading and performing development, with strong command of one or more programming languages such as Python, PySpark, etc.
• 4–6 years of hands-on experience developing and deploying cloud-native solutions on AWS, including Compute (EC2, Lambda), Storage (S3) and Database (RDS, Aurora, Postgres, DynamoDB) services.
• Hands-on experience with orchestration tools such as Apache Airflow, Step Functions and SNS.
• Strong expertise in ETL/Analytics services (Glue, EMR, Athena, Redshift), Infrastructure (CloudFormation, CodePipeline) and Data Migration tools (AWS DataSync, AWS DMS).
• Working knowledge of API Gateway and IAM for secure service integration and access management.
• Expertise in handling large datasets and data models, including design, data model creation and development of data pipelines for ingestion, migration and transformation.
• Strong hands-on experience with SQL Server and stored procedures.
• Strong problem-solving and analytical skills, with the ability to work independently and lead development efforts in a fast-paced environment.
• Excellent communication skills, with the ability to collaborate across technical and business stakeholders.
• Education: Bachelor's or Master's degree in Computer Science, Engineering or related field (60% above).
• Degrees/Field of Study required: Master of Engineering, Bachelor of Engineering.

Nice to have

• Knowledge of APIs and API integration patterns.
• Familiarity with SSO (Single Sign-On) implementations.
• Exposure to streaming technologies (e.g., Kafka, Kinesis or similar).

Details

• Location: Bengaluru Millenia.
• Years of experience required: 4–10 years.
• Visa sponsorship: No.
• Government clearance required: No.
• Job posting end date: April 14, 2026.