Data Engineer

Overview

As a Data Engineer, design, develop, and maintain data solutions supporting data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems.

What you'll do

• Design, develop, and maintain comprehensive data solutions for data generation, collection, and processing.
• Create efficient data pipelines.
• Ensure the integrity and quality of data throughout its lifecycle.
• Implement extract, transform, and load processes to migrate and deploy data across systems.
• Collaborate with and manage the team to perform as an SME.
• Make decisions for the team.
• Engage with multiple teams and contribute to key decisions.
• Provide solutions to problems for the immediate team and across multiple teams.
• Lead efforts to optimize data workflows and improve system performance.
• Mentor junior team members to support their professional growth and development.

What you'll need

• Minimum 7.5 year(s) of experience in Microsoft Azure Databricks.
• 15 years full time education.
• Proficiency in Microsoft Azure Databricks.
• Experience with cloud-based data platforms and distributed computing environments.
• Strong knowledge of data pipeline architecture and ETL process design.
• Familiarity with data storage solutions and data warehousing concepts.
• Ability to troubleshoot and resolve complex data integration issues.
• Understanding of data governance and security best practices.

Details

• Based at the BDC7A - SEZ office in Bengaluru.