Senior Databricks Engineer

Overview

Senior Databricks Engineer focused on building and governing a Databricks-first Lakehouse/data platform on Azure.

What you'll do

• Design and implement scalable Lakehouse architectures in Databricks.
• Build and manage Delta Live Tables (DLT) pipelines for data transformations.
• Govern data assets with Unity Catalog, including fine-grained access control and lineage tracking.
• Tune Spark jobs and Delta tables for performance using optimization techniques.
• Orchestrate multi-task data pipelines using Databricks Workflows.
• Develop ELT/ETL and streaming pipelines ingesting from APIs, databases, and files.

What you'll need

• Databricks Certified Data Engineer Professional or Associate (mandatory).
• Microsoft Certified: Azure Data Engineer Associate (mandatory).
• 10+ years of hands-on experience in Data Engineering roles.
• Advanced PySpark and Python for large-scale distributed data processing.
• Strong SQL skills for query authoring, performance tuning, and data modeling.
• Experience with Azure Data Factory and ADLS Gen2, plus Azure Synapse Analytics.
• Hands-on Azure DevOps CI/CD and Infrastructure as Code using Terraform or Bicep.

Details

• Location: Bengaluru, India.