Data Engineer

Overview

Data Engineer responsible for building scalable Python-based data pipelines, data services, and cloud data solutions. The role involves processing large datasets while maintaining performance, reliability, and data quality.

What you'll do

• Design and develop scalable data pipelines and ETL/ELT processes.
• Build and maintain data services and APIs for data consumption.
• Ensure data quality, validation, and consistency across pipelines.
• Optimize workflows for scalability, performance, and cost efficiency.
• Process high-volume and high-velocity datasets.
• Mentor junior team members.
• Collaborate across teams and contribute to technical decisions.

What you'll need

• At least 7.5 years of total experience.
• At least 10 years of experience with Python.
• Proficiency in Python programming.
• Experience building scalable data pipelines and distributed processing systems.
• Knowledge of SQL and NoSQL databases and query optimization.
• Experience with multi-cloud platforms such as AWS, Azure, or Google Cloud.
• 15 years of full-time education.

Nice to have

• Experience with Ab Initio.
• Exposure to Java or Scala in distributed environments.

Details

• Location: Pune.