Data Engineer

Overview

As a Data Engineer, design, develop and maintain data solutions for data generation, collection and processing. Create data pipelines, ensure data quality, implement ETL processes, and support data migration and deployment across systems.

What you'll do

• Design, develop and maintain comprehensive data solutions.
• Create efficient data pipelines and ensure data quality.
• Implement extract, transform and load processes to facilitate data flow across systems.
• Collaborate with cross-functional teams to understand data requirements and deliver scalable data solutions.
• Monitor and optimize data pipelines to ensure high performance and reliability.
• Document data processes and workflows to maintain clarity and support knowledge sharing.
• Perform independently and become an SME.
• Participate actively and contribute in team discussions.
• Contribute solutions to work-related problems.
• Assist junior team members by providing guidance and support in their tasks.

What you'll need

• Minimum 3 year(s) of experience in Data Engineering.
• 15 years full time education.
• Data Engineering proficiency.
• Databricks Unified Data Analytics Platform proficiency.
• PySpark proficiency.
• Strong knowledge of data pipeline architecture and ETL process design.
• Experience with distributed computing frameworks and big data technologies.
• Ability to work with cloud-based data storage and processing platforms.
• Familiarity with data quality assurance and data governance practices.

Details

• Based at the Hyderabad office.