Data Engineer

Overview

Design, develop and maintain data solutions for data generation, collection and processing, creating data pipelines, ensuring data quality and implementing ETL processes to migrate and deploy data across systems.

What you'll do

• Design, develop and maintain data solutions for data generation, collection and processing.
• Create and manage scalable data pipelines and workflows.
• Implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
• Ensure data quality and troubleshoot data quality and pipeline issues efficiently.
• Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.
• Monitor and optimize data workflows to improve performance and reliability.
• Document data processes and maintain clear communication with stakeholders.
• Assist junior team members by sharing knowledge and providing guidance.

What you'll need

• Minimum 3 years of experience in Databricks Unified Data Analytics Platform.
• Proficiency in Databricks Unified Data Analytics Platform.
• Experience in building and managing scalable data pipelines and workflows.
• Strong understanding of data integration, transformation and ETL methodologies.
• Familiarity with cloud-based data storage and processing solutions.
• Ability to troubleshoot and resolve data quality and pipeline issues efficiently.
• Knowledge of scripting and automation to streamline data operations.
• 15 years full time education is required.

Details

• Location: Hyderabad office.