Data Engineer

Overview

As a Data Engineer, design, develop and maintain robust data solutions for data generation, collection and processing. Create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems.

What you'll do

• Design, develop and maintain data solutions for data generation, collection and processing.
• Create efficient data pipelines to facilitate smooth data flow.
• Ensure the accuracy and quality of data.
• Implement extract, transform and load processes to enable data migration and deployment across systems.
• Perform independently and become an SME.
• Participate actively and contribute in team discussions.
• Contribute solutions to work-related problems.
• Collaborate with cross-functional teams to understand data requirements and deliver scalable data solutions.
• Monitor and troubleshoot data pipelines to ensure reliability and performance.
• Document data processes and workflows to maintain clarity and support knowledge sharing.
• Assist junior team members in understanding project requirements and technical challenges.

What you'll need

• Minimum 3 year(s) of experience.
• 15 years full time education.
• Proficiency in AWS Glue.
• Proficiency in PySpark.
• Experience in designing and implementing scalable data pipelines and ETL workflows.
• Strong knowledge of cloud-based data processing and storage solutions.
• Ability to optimize data workflows for performance and cost efficiency.
• Familiarity with data quality frameworks and best practices for data validation.
• Experience with scripting and automation to support data engineering tasks.
• Minimum 2 years of experience in AWS Glue.

Details

• This position is based at the Pune office.