YouGov logo

Senior Data Engineer

YouGov
NewPosted today

LOCATION

Mumbai · Hybrid

EXPERIENCE

Not specified

TYPE

FullTime

SKILLS REQUIRED

Data EngineeringData PipelinesData ModelingData WarehousingMicrosoft FabricSQLPower BiDAXPySpark

Job description

Overview

Senior Data Engineer owning the data pipelines, models and Microsoft Fabric architecture that underpin YouGov's Power BI reporting and analytics, with technical direction and mentoring of junior engineers.

What you'll do

  • Design and implement scalable data pipelines and ETL/ELT processes using Microsoft Fabric to deliver reliable, timely data for reporting.
  • Build and maintain data warehouse, data lake and lakehouse architectures within the Fabric ecosystem, implementing OneLake integration patterns.
  • Develop and optimise semantic models for performance and scalability, applying DAX and data-model best practices.
  • Determine methods and procedures on new data engineering assignments, evaluating complex and variable factors to select the right approach.
  • Leverage Fabric workloads (Data Factory, Synapse Data Engineering, Data Warehouse) and Spark notebooks for large-scale data processing.
  • Configure and manage Fabric workspaces, security and governance, including row-level security and capacity monitoring and optimisation.
  • Ensure compliance with data privacy regulations (e.g. GDPR) and enforce data standards and best practices across the platform.
  • Provide technical guidance on data architecture decisions and develop models and procedures within the discipline.
  • Mentor junior data engineers, reviewing work and building the team's internal capability.
  • Work closely with BI developers to deliver robust reporting solutions that deliver value to the business.
  • Document technical designs, processes and best practices so the platform is supportable and knowledge is retained in-house.

What you'll need

  • Extensive experience in data engineering or related roles.
  • Hands-on Power BI experience, including advanced DAX, Power Query (M), data modelling/star schema design, Power BI Service administration and Premium/Fabric capacity management.
  • Experience with Microsoft Fabric, or comparable experience with Azure Synapse Analytics, Azure Data Factory or Databricks.
  • Strong SQL skills and solid grounding in data warehousing and lakehouse architecture concepts.
  • Programming experience in Python or PySpark, with proficiency in version control (Azure DevOps) and CI/CD practices.
  • Experience with Azure cloud services (e.g. Data Lake Storage, Event Hubs, Stream Analytics) and data orchestration/workflow management.
  • Microsoft certifications (DP-203, DP-600 or DP-700), or similar.

Details

  • Location: Mumbai, India.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Senior Data Engineer