Data Engineer

Overview

Data Engineer role within the English and Exams Data Team in the Digital and Technology function, designing, building and maintaining scalable data pipelines, platforms and reusable data assets.

What you'll do

• Design, build and maintain complex data pipelines and data flows that integrate operational systems and key data sources.
• Deliver scalable batch and streaming data solutions aligned with enterprise architecture and engineering standards.
• Ensure solutions are secure, resilient and well documented.
• Promote the reuse of data assets, patterns and data flows across teams.
• Work closely with the English and Exams Data Team and cross-functional teams including Architecture, Product, Delivery, Operations and Performance.
• Align with enterprise data governance standards and policies defined by the Data, Evidence and Performance (DEP) function.
• Champion data engineering best practices, standardisation and continuous improvement.
• Create technical documentation, training materials and knowledge-sharing resources for the wider Data Engineering community.

What you'll need

• Working knowledge of at least one cloud-based data warehouse platform: AWS Redshift, Azure Fabric/Synapse, Snowflake or Google BigQuery.
• Create scalable data pipelines to ingest, transform, and serve structured and unstructured data.
• Good working knowledge of SQL and Python for data querying, transformation and processing.
• Design and implement Lakehouse, Data Warehouse, and Medallion architecture solutions.
• Experience with Delta Lake, Parquet, and modern data lake architectures.
• Knowledge of data modelling, performance optimisation, security and data governance.
• Experience delivering enterprise-scale cloud data solutions in Agile environments.
• Experience implementing CI/CD pipelines using Azure DevOps or GitHub.
• Collaborate with business stakeholders, data analysts, architects, and engineering teams to deliver data solutions.
• Advanced level of Power BI or Tableau for data visualisation.
• Experience supporting large change projects/programmes covering digital transformation, across integration, application and information architecture domains.
• Knowledge of core business ecosystems (including HR, Finance, Procurement, Contact Centre Management, Service Management, Marketing, Identity, Sales, and Digital and Technology) and experience of their technology related implementations, including multi cloud infrastructure and network capabilities across Azure, AWS, public and private cloud.
• Experience in Cyber Security best practices, ideally within a UK Government context (OWASP, NCSC, ISO27xxx standards), and experience architecting to GDPR.
• Degree in Computer Science, Information Technology, or related discipline; or equivalent experience working in a related field.
• Written and verbal proficiency in English is required.

Nice to have

• Experience in cloud migration, especially to Microsoft Fabric/Azure.
• Advisory or consulting experience.
• Experience of leading projects.
• Microsoft certified Data Engineer.
• Cloud certified Data Engineer (Microsoft, AWS, etc).

Details

• Location: Noida, India.
• Employment type: Indefinite contract, Pay Band 8, Digital and Technology department.
• Candidates must have the pre-existing, legal right to work in India; no mobility, relocation or visa sponsorship support is provided.
• Hybrid working may be available, subject to line management approval and at interview.