Data Engineer

Overview

Design, develop and maintain data solutions for data generation, collection and processing, building pipelines and ETL processes to migrate and deploy data across systems.

What you'll do

• Design, develop and maintain data solutions for data generation, collection, and processing.
• Create data pipelines and ensure data quality.
• Implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
• Collaborate with cross-functional teams to understand their data needs and provide effective solutions.
• Ensure the data infrastructure is robust and scalable to meet organizational demands.
• Be an SME, collaborate with and manage the team, and take responsibility for team decisions.
• Engage with multiple teams and contribute to key decisions, providing solutions to problems for the immediate team and across teams.
• Mentor junior team members to enhance their skills and knowledge in data engineering.
• Continuously evaluate and improve data processes to enhance efficiency and effectiveness.

What you'll need

• Proficiency in Databricks Unified Data Analytics Platform.
• Minimum 5 years of experience in Databricks Unified Data Analytics Platform.
• 15 years full time education.

Nice to have

• Experience with cloud platforms such as AWS or Azure.
• Strong understanding of data modeling and database design principles.
• Experience with programming languages such as Python or Scala for data processing.
• Familiarity with data warehousing concepts and tools.

Details

• Based at the Bengaluru office.