Data Engineer

Overview

Design, develop and maintain data solutions for data generation, collection, and processing, including data pipelines, data quality and ETL processes to migrate and deploy data across systems.

What you'll do

• Design, develop and maintain data solutions for data generation, collection, and processing.
• Create data pipelines and ensure data quality throughout the data lifecycle.
• Implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
• Collaborate with multiple teams and contribute to key decisions as an SME.
• Lead efforts to optimize data workflows and improve system performance.
• Provide solutions to problems for your immediate team and across multiple teams.
• Mentor junior team members to support their professional growth and skill development.

What you'll need

• 15 years full time education.
• Minimum 5 years of experience in Databricks Unified Data Analytics Platform.
• Proficiency in Databricks Unified Data Analytics Platform.
• Strong knowledge of data pipeline architecture and implementation.
• Experience in managing large-scale data processing and integration.
• Familiarity with cloud-based data platforms and distributed computing.
• Ability to troubleshoot and resolve complex data-related issues efficiently.

Nice to have

• Experience with Generative AI.

Details

• Location: Pune (based at PDC5A - SEZ location).