Sr Data Engineer

Overview

Senior Data Engineer role in Shell’s Trading & Supply data/analytics team, focused on building and optimizing high-performance data engineering solutions for business decision-making.

What you’ll do

• Design, develop, and maintain scalable, high-performance data engineering solutions.
• Build and optimize end-to-end data pipelines using Azure Data Factory, Azure Data Lake Storage, Databricks, PySpark, Python, and SQL.
• Implement data modeling strategies for enterprise reporting, analytics, and operational needs.
• Drive continuous improvement by optimizing data products, processes, applications, and platform performance.
• Apply performance tuning using PySpark and SQL to improve efficiency and scalability.
• Support enterprise data platforms including Master Data Management, Data Catalog, and analytics solutions.
• Manage source control, CI/CD, and release management using GitHub and Azure DevOps.

What you’ll need

• 8–10 years of experience in Data Engineering.
• Strong trading & supply domain experience, including Endur and Nucleus.
• Expertise in Microsoft Azure technologies such as ADF, ADLS, Azure Databricks, and Azure Fabric (as listed).
• Hands-on PySpark, Python, Advanced SQL, and Data Modeling experience.
• Proven SQL query optimization and PySpark performance tuning expertise.
• Experience with source control and DevOps practices using GitHub and Azure DevOps.
• Databricks Certified Associate certification required.