Data Engineer (GCP, Azure)

Overview

Data Engineer responsible for building and maintaining data pipelines and integrating cloud services for scalable data solutions.

What you'll do

• Develop and optimize data pipelines to enable seamless data flow across systems.
• Manage databases by ensuring integrity and implementing storage and retrieval solutions.
• Integrate cloud services (MS Azure, GCP, AWS) to architect and deploy data solutions.
• Collaborate to integrate machine learning models into data pipelines.
• Work with Spark and Kafka for real-time data processing and analytics.
• Use Python and SQL to support ETL (extraction, transformation, loading) of data.

What you'll need

• Proficiency in Python.
• Proficiency in SQL.
• Experience with data pipelines and ETL.
• Experience with cloud services, with MS Azure and GCP preferred.
• Experience with ML modeling.
• Experience with Spark and Kafka.
• Excellent communication skills for collaboration with teams and stakeholders.

Details

• Location: Pune, Maharashtra, India.