AWS Glue Data Engineer(Redshift+Pyspark+Kinesis) - Senior Associate

Overview

Senior Associate role in PwC's Acceleration Center India, designing and building data pipelines, integration flows and transformation solutions with AWS Glue, Redshift, PySpark and Kinesis within the Data and Analytics Engineering practice.

What you'll do

• Design and build AWS Glue data pipelines to move, transform and load data across Redshift and cloud data stores
• Develop PySpark jobs for batch and streaming processing, with attention to code readability, performance and maintainability
• Integrate Kinesis data streams into ingestion workflows for near real-time processing and downstream analytics use cases
• Create data models and transformation logic that support warehouse development, reporting and analytical access patterns
• Tune query performance and pipeline throughput in Redshift, Spark and related data engineering platforms
• Troubleshoot data integration issues by reviewing source systems, transformation logic and downstream dependencies
• Collaborate with client stakeholders to gather requirements, clarify data needs and translate them into technical deliverables
• Review work from junior team members and provide guidance on data pipeline design, development standards and delivery approach
• Apply cloud engineering and data modernization methods to support scalable data platform implementation and migration activities

What you'll need

• At least a Bachelor's degree
• At least 5+ years of experience
• Oral and written proficiency in English

Nice to have

• Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
• Demonstrating hands-on AWS Glue and PySpark data pipeline development
• Developing Redshift-based data models and performance tuning approaches
• Utilizing Kinesis streaming to build real-time data ingestion solutions
• Applying data engineering tools across cloud modernization initiatives
• Interpreting complex data needs and translating them into deliverables
• Mentoring junior team members while navigating client workstreams