Overview
Senior Associate Azure Data Engineer / Microsoft Fabric Analytics Engineer within PwC's Data, Analytics & AI specialism, designing and maintaining scalable data solutions on Azure Data Services and Microsoft Fabric.
What you'll do
- Design, develop and maintain end-to-end data pipelines and data integration solutions using Azure Data Factory and Microsoft Fabric.
- Build and optimize Lakehouse and Data Warehouse solutions within Microsoft Fabric.
- Develop data transformation logic using PySpark, Spark SQL and Python.
- Implement medallion architecture (Bronze, Silver, Gold) for data lake solutions.
- Create and manage data models, semantic models and datasets for reporting and analytics.
- Ensure data quality, consistency and security across all data platforms.
- Monitor, troubleshoot and optimize data pipeline performance.
- Collaborate with data architects, data scientists, analysts and business stakeholders to understand data requirements.
- Implement data governance policies and best practices.
- Document technical designs, data flows and solution architectures.
- Stay updated with the latest Azure and Microsoft Fabric features and best practices.
What you'll need
- 5+ years of hands-on experience in data engineering and analytics.
- Proficiency in Azure Data Services: Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2) and Azure SQL Database.
- Proficiency in Microsoft Fabric workloads: Data Engineering (Lakehouse, Notebooks), Data Warehouse, Data Pipelines and OneLake.
- Strong programming skills in PySpark, Spark SQL, Python and SQL.
- Experience with data modeling (dimensional modeling, star/snowflake schemas).
- Knowledge of ETL/ELT design patterns and best practices.
- Experience with Delta Lake and lakehouse architecture.
- Strong analytical, problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
- Education: Bachelor of Engineering or Master of Engineering (BE, B.Tech, ME, M.Tech, MBA, MCA, 60% and above).
Nice to have
- Microsoft Certified: Azure Data Engineer Associate (DP-203).
- Microsoft Certified: Fabric Analytics Engineer Associate (DP-600).
- Experience with Databricks and Delta Lake.
- Experience with Power BI for data visualization and reporting.
- Knowledge of CI/CD pipelines for data engineering (Azure DevOps, Git).
- Experience working in Agile/Scrum environments.
- Exposure to data quality frameworks and tools.
Details
- Location: Bangalore.
- Employment type: Full Time.
- Visa sponsorship: No.
- Government clearance required: No.
Read the full description and apply on the company’s own careers page.