IFC - Cloud Data Engineer

Overview

Build and maintain the data systems (pipelines, data warehouses and data lakes) that collect, store, process and analyse data, ensuring it is accurate, accessible and secure. Join Barclays as a Cloud Data Engineer to spearhead the evolution of infrastructure and deployment pipelines.

What you'll do

• Build and maintain data architectures and pipelines that enable the transfer and processing of durable, complete and consistent data.
• Design and implement data warehouses and data lakes that manage the appropriate data volumes and velocity and adhere to required security measures.
• Develop processing and analysis algorithms fit for the intended data complexity and volumes.
• Collaborate with data scientists to build and deploy machine learning models.
• Manage and support container platforms including OpenShift and Kubernetes environments.

What you'll need

• Experience building and maintaining data architectures and pipelines.
• Experience designing and implementing data warehouses and data lakes.
• Experience developing processing and analysis algorithms.
• Experience collaborating with data scientists on machine learning models.
• Experience managing and supporting container platforms including OpenShift and Kubernetes environments.
• AWS hands-on experience with Databricks, S3, EC2, Lambda, RDS, Glue, Athena, data pipelines, Step Functions and analytical services.
• Experience of distributed computing architecture and core Hadoop components (HDFS, Spark, YARN, Hive, Impala).

Nice to have

• Expertise in SQL, including advanced SQL skills.
• Expertise in shell scripting and programming (Python).
• Experience leading and supervising a team, guiding professional development, allocating work and coordinating team resources.

Details

• Location: Pune (Gera Commerzone SEZ).
• Assessed on risk and controls, change and transformation, business acumen, strategic thinking, and digital and technology skills, as well as job-specific technical skills.