CPW Data Engineer II

Overview

CPW Data Engineer II will build and maintain data assets and scalable ETL/ELT pipelines on Azure to support reporting, analytics, and BI.

What you'll do

• Build high-quality data assets for business advantage.
• Develop and maintain ETL/ELT pipelines using Azure Databricks and PySpark.
• Design and maintain Bronze, Silver, and Gold data-layer architectures.
• Implement incremental processing, deduplication, data validation, and performance optimization.
• Establish and maintain data governance and stewardship practices focused on quality and security.
• Integrate data from multiple sources including Nielsen, Circana, internal systems, panel data, and RMS data.
• Optimize queries, Delta storage formats, pipelines, workflows, scalability, and cost efficiency.

What you'll need

• 7+ years of relevant data engineering experience.
• Bachelor’s degree in Computer Science, Information Technology, Electronics and Telecommunications, or related field.
• Mandatory experience working with data lakes and multiple data sources.
• Hands-on experience with SQL, PySpark, Azure Databricks, and Azure Data Factory.
• Knowledge of data warehousing concepts, ETL frameworks, and business intelligence platforms.
• Experience with Delta Lake architecture and large-scale data processing.
• Strong understanding of data modeling, data integration, and data quality principles.

Nice to have

• Master’s degree in a related field.
• Experience in the FMCG industry.
• Experience developing business intelligence platforms or 360-degree data views.
• Experience with Azure Storage Accounts, Azure Key Vault, and Azure DevOps.
• Familiarity with data governance, data security, and stewardship frameworks.

Details