Cloud Data Engineer

Overview

Build and maintain data systems including pipelines, data warehouses, and data lakes to keep data accurate, accessible, and secure.

What you'll do

• Build and maintain data architectures and pipelines for consistent data transfer and processing.
• Design and implement data warehouses and data lakes with appropriate volume/velocity handling and security measures.
• Develop data processing and analysis algorithms for intended complexity and volumes.
• Collaborate with data scientists to build and deploy machine learning models.
• Perform assigned activities on time and to a high standard through continuous improvement.
• Lead and supervise a team, including allocating work and coordinating resources.
• Take responsibility for end results of team operational processing and activities, including risk/control ownership.

What you'll need

• Strong experience with ETL tools such as Ab Initio, Glue, PySpark, Python, DBT, DataBricks, and AWS required services/products.
• Advanced SQL knowledge across multiple database platforms (e.g., Teradata, Hadoop, SQL).
• Experience with data warehousing concepts and dimensional modeling.
• Proficiency in scripting languages (Python, Perl, Shell scripting) for automation.
• Experience in ETL development and data integration.
• Proven track record of implementing complex ETL solutions in enterprise environments.

Nice to have

• Knowledge of big data technologies (Hadoop, Spark, Hive).
• Knowledge of cloud data platforms (AWS, Azure, GCP) and their ETL services.

Details

• Role is based in Pune.