Data Engineer

Overview

As a Data Engineer, design, develop, and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems.

What you'll do

• Design, develop, and maintain comprehensive data solutions that support the generation, collection, and processing of data.
• Create efficient data pipelines and ensure the integrity and quality of data throughout its lifecycle.
• Implement extract, transform, and load processes to facilitate data migration and deployment across various systems.
• Collaborate with different teams to align data strategies and optimize workflows.
• Collaborate and manage the team to perform as a subject matter expert.
• Make team decisions.
• Engage with multiple teams and contribute to key decisions.
• Provide solutions to problems that apply across multiple teams.
• Lead the development and optimization of data pipelines to support business needs.
• Ensure adherence to data governance and compliance standards within the team.
• Mentor junior team members to foster skill development and knowledge sharing.

What you'll need

• Minimum 12 year(s) of experience is required.
• Minimum 12 years of experience in Databricks Unified Data Analytics Platform.
• Proficiency in Databricks Unified Data Analytics Platform.
• Experience in designing and implementing scalable ETL processes.
• Strong knowledge of data integration techniques and data pipeline orchestration.
• Familiarity with cloud-based data storage and processing solutions.
• Ability to troubleshoot and optimize data workflows for performance and reliability.
• Understanding of data quality frameworks and best practices.
• 15 years full time education.

Details

• Based at the Bengaluru office.