Senior Data Engineer

Overview

Senior Data Engineer to design, build, and optimize large-scale data pipelines and data warehousing solutions using Azure Databricks.

What you'll do

• Design, develop, and maintain scalable data pipelines using Python.
• Perform distributed data processing with PySpark on Azure Databricks.
• Implement and manage Delta Lake and Databricks cluster configurations.
• Develop ETL/ELT workflows for structured and unstructured data.
• Optimize data warehouse performance via schema design and query tuning.
• Use Apache Airflow for scheduling and workflow management.
• Work with cross-functional teams to deliver data solutions.

What you'll need

• Advanced proficiency in Python for data engineering.
• Hands-on experience with PySpark.
• Deep expertise in Azure Databricks including Delta Lake and cluster management.
• Strong experience with SQL for analytics and data warehousing.
• Experience with data warehousing platforms such as Snowflake, Azure Synapse Analytics, or AWS Redshift.
• Working knowledge of cloud platforms: Azure.

Details

• Location: Bangalore.
• Work mode: Hybrid.
• Employment type: Full-Time.