Data Engineer

Overview

Design, develop and maintain data solutions for data generation, collection and processing, creating data pipelines and ETL processes to migrate and deploy data across systems.

What you'll do

• Design, develop and maintain data solutions for data generation, collection, and processing.
• Create efficient data pipelines that facilitate smooth data flow.
• Ensure the integrity and quality of data throughout its lifecycle.
• Implement extract, transform, and load processes to enable migration and deployment of data across systems.
• Collaborate with different teams to align data strategies with organizational goals.
• Continuously optimize data workflows to support business needs.
• Lead efforts to identify and resolve data-related challenges, ensuring minimal disruption to operations.
• Engage with multiple teams and contribute on key decisions.
• Support junior team members by providing guidance and facilitating their professional growth.

What you'll need

• Minimum 7.5 years of experience in Data Engineering.
• Proficiency in Data Engineering.
• Proficiency in AWS Glue.
• Proficiency in PySpark.
• 15 years full time education.

Nice to have

• Experience with AWS Glue, PySpark.
• Strong knowledge of data pipeline architecture and best practices for data integration.
• Experience with designing and implementing scalable ETL processes.
• Familiarity with cloud-based data storage and processing solutions.
• Ability to optimize data workflows for performance and reliability.

Details

• Based at the Bengaluru office.