Data Engineer

Overview

Data Engineer role focused on designing, developing, and maintaining data solutions, including data pipelines and ETL/ELT processes for migrating and deploying data across systems.

What you'll do

• Design, develop, and maintain data solutions for data generation, collection, and processing.
• Create data pipelines and ensure data quality throughout the data lifecycle.
• Implement ETL processes to extract, transform, and load data for migration and deployment.
• Build and operate scalable lakehouse pipelines on Databricks/Azure and manage ELT/streaming.
• Own Delta Lake optimization, Unity Catalog governance, and CI/CD.
• Integrate ADLS/ADF/Synapse and deliver data sets for BI/ML/GenAI.

What you'll need

• Microsoft Azure Databricks proficiency.
• Minimum 5 years of experience in Microsoft Azure Databricks.
• PySpark and SQL.
• Databricks components including Delta and DLT/Workflows.
• Azure data services, Unity Catalog, and CI/CD.
• Ability to build scalable, reliable cloud-based data pipelines.
• Strong knowledge of data integration techniques and ETL process design.

Details

• Location: Bengaluru.
• Position based at the Pune office.