Senior Data Engineer

Overview

Senior Data Engineer owning data pipelines, models and Microsoft Fabric architecture underpinning YouGov's Power BI reporting and analytics, working autonomously and mentoring junior engineers.

What you'll do

• Design and implement scalable data pipelines and ETL/ELT processes using Microsoft Fabric to deliver reliable, timely data for reporting.
• Build and maintain data warehouse, data lake and lakehouse architectures within the Fabric ecosystem, implementing OneLake integration patterns.
• Develop and optimise semantic models for performance and scalability, applying DAX and data-model best practices.
• Determine methods and procedures on new data engineering assignments, evaluating complex and variable factors to select the right approach.
• Leverage Fabric workloads (Data Factory, Synapse Data Engineering, Data Warehouse) and Spark notebooks for large-scale data processing.
• Configure and manage Fabric workspaces, security and governance, including row-level security and capacity monitoring and optimisation.
• Ensure compliance with data privacy regulations (e.g. GDPR) and enforce data standards and best practices across the platform.
• Provide technical guidance on data architecture decisions and develop models and procedures within the discipline.
• Mentor junior data engineers, reviewing work and building the team's internal capability.
• Work closely with BI developers to deliver robust reporting solutions that deliver value to the business.
• Document technical designs, processes and best practices so the platform is supportable and knowledge is retained in-house.

What you'll need

• Extensive experience in data engineering or related roles.
• Hands-on Power BI experience, including advanced DAX, Power Query (M), data modelling/star schema design, Power BI Service administration and Premium/Fabric capacity management.
• Experience with Microsoft Fabric, or comparable experience with Azure Synapse Analytics, Azure Data Factory or Databricks.
• Strong SQL skills and solid grounding in data warehousing and lakehouse architecture concepts.
• Programming experience in Python or PySpark, with proficiency in version control (Azure DevOps) and CI/CD practices.
• Experience with Azure cloud services (e.g. Data Lake Storage, Event Hubs, Stream Analytics) and data orchestration/workflow management.
• Microsoft certifications (DP-203, DP-600 or DP-700), or similar.
• Works autonomously, with authority over day-to-day priorities and the judgement to determine methods and approach on new assignments.
• Solves complex, non-routine problems by weighing variable factors and adapting established techniques, rather than applying a set procedure.
• Knows when to escalate and when to decide.
• Conveys complex technical information persuasively to non-technical audiences, adapting style to the listener and developing recommendations that stakeholders can act on.
• Provides work direction, mentoring and design review to less experienced colleagues without formal line management authority, giving feedback that raises the standard of the team's output.
• Builds working relationships beyond the immediate team, advising colleagues across functions and locations and negotiating priorities where demand competes.
• Owns quality and governance standards for their own area, holds others to them, and raises problems early rather than working around them.
• Works comfortably with ambiguity on new engineering assignments, defining the approach where no precedent exists and documenting it so others can follow.

Nice to have

• Keeps pace with the modern data stack and the Fabric roadmap, evaluating new capabilities on their merits and championing those that earn their place.

Details

• Location: Mumbai, India.