Senior Engineer - Data

Overview

Senior Engineer - Data role at M&G India, the strategic innovation and digital hub for M&G, focused on building and operationalizing Azure-based data solutions for the business.

What you'll do

• Work collaboratively with colleagues and take personal accountability to maintain and enhance the controls you are responsible for, supporting improvement of the overall control environment, customer outcomes and a reduction in M&G plc's operational risk.
• Build and operationalize data solutions for the business using Azure services in combination with custom solutions, such as Azure Data Factory, Azure Data Flows, Azure Databricks, Azure Data Lake Gen 2 and Azure SQL.
• Migrate on-premise data warehouses to data platforms on Azure cloud.
• Design and implement data engineering, ingestion and transformation functions using ADF and Databricks.
• Perform capacity planning and performance tuning on ADF and Databricks pipelines.
• Work in secured Azure environments using Azure KeyVaults, Service Principals and Managed Identities.
• Work within offshore office-based development teams, participating in typical project lifecycle activities such as requirement analysis, testing and release.
• Interact with the business for requirement gathering and query resolution.

What you'll need

• Proficiency in PySpark.
• Experience in relational and dimensional modelling, including big data technologies.
• Experience of migrating on-premise data warehouses to data platforms on Azure cloud.
• Experience designing and implementing data engineering, ingestion and transformation functions using ADF and Databricks.
• Experience of working in secured Azure environments using Azure KeyVaults, Service Principals and Managed Identities.
• Stakeholder management, process adherence, planning and documentation skills.

Details

• Location: Pune.