Data Engineer - Senior Associate

Overview

Senior Associate Data Engineer role at PwC’s Acceleration Center India, focused on designing and building data engineering solutions and software that support client digital transformation.

What you'll do

• Design and build scalable data pipelines, data products, and analytics solutions using Spark, Python, and SQL.
• Develop and optimize data engineering solutions on cloud data platforms and lakehouse architectures (e.g., Databricks, Snowflake, Fabric).
• Build cloud-native data solutions using Azure services (Azure Cloud, Azure DevOps, Azure Storage, Azure Data Services).
• Apply data modeling techniques and architectural patterns including data lake, lakehouse, Delta Lake, and data warehouse solutions.
• Implement CI/CD pipelines, automated testing, and version control for reliable deployments.
• Support distributed data processing solutions using Apache Spark and related frameworks.
• Collaborate across teams to translate business and user requirements into data engineering solutions.

What you'll need

• Bachelor’s degree or equivalent experience.
• 5 to 8 years of relevant experience in data engineering or related technology roles.
• Use Spark, Python, and SQL for data engineering and analytics solutions.
• Experience with automated testing, performance tuning, monitoring, and operational readiness.

Nice to have

• Experience with agentic AI frameworks such as LangChain, LangGraph, AutoGen, or Semantic Kernel.
• Strong understanding of LLMs, prompt engineering, vector databases, semantic search, embeddings, and AI evaluation frameworks.
• Experience delivering AI-enabled data products combining structured and unstructured data.

Details

• Location: Bangalore.
• Travel requirement: Up to 20%.