Senior Data Engineer

Overview

Senior Data Engineer focused on building and optimizing large-scale data pipelines and data warehousing solutions on cloud platforms, especially Azure Databricks.

What you'll do

• Design, develop, and maintain scalable data pipelines using Python.
• Use PySpark for distributed data processing on Azure Databricks.
• Implement and manage Delta Lake and Databricks cluster configurations.
• Develop ETL/ELT workflows for structured and unstructured data.
• Optimize data warehouse performance via schema design and query tuning.
• Schedule and manage workflows using Apache Airflow.
• Ensure data reliability, governance, and platform best practices.

What you'll need

• Advanced proficiency in Python for data engineering.
• Hands-on experience with PySpark.
• Deep expertise in Azure Databricks, including Delta Lake and cluster management.
• Strong SQL experience for analytics and data warehousing.
• Experience with data warehousing platforms including Snowflake, Azure Synapse Analytics, and/or AWS Redshift.
• Working knowledge of cloud platforms, specifically Azure.

Details

• Location: Bangalore.
• Work mode: Hybrid.
• Employment type: Full-Time.