Lead solution architect - Data engineering

Overview

Lead Solution Architect for Data Engineering, responsible for designing and optimizing end-to-end cloud-native data platforms using Azure and Databricks.

What you'll do

• Architect end-to-end cloud-native data platforms using Azure services.
• Define data modeling standards (dimensional, canonical, domain-driven designs).
• Design Delta Lake architectures using medallion (Bronze–Silver–Gold) frameworks.
• Develop scalable and secure ETL/ELT pipelines with Databricks (PySpark/Spark SQL).
• Implement Delta Lake best practices and optimize Spark workloads for performance and cost.
• Integrate Azure data services and build CI/CD workflows and infrastructure via IaC.
• Lead governance and security through Unity Catalog and GDPR-compliant design.

What you'll need

• 7+ years in Data Architecture or Data Engineering roles.
• Expert knowledge of Azure Databricks (Spark, Delta Lake, MLflow).
• Expert knowledge of Azure Data Lake Gen2 and Azure Data Factory/Synapse Pipelines.
• Strong programming experience in PySpark, SQL, and Python.
• Hands-on CI/CD experience with Azure DevOps or GitHub Actions.
• Formal education of a Bachelor's degree (or higher), ideally in related fields, or equivalent experience.

Details

• Location: Pune, India.
• Travel: up to 10% expected.
• Work mode: hybrid of office/remote working.
• Relocation assistance: eligible for relocation within country.