Lead Data Engineer (Data Platforms)

Overview

Lead Data Engineer responsible for designing, building, and scaling cloud-based data, analytics, and BI solutions for a multi-cloud data platform.

What you'll do

• Design cloud-native data and BI solutions using Databricks and Snowflake on AWS.
• Build scalable data pipelines and analytics frameworks for enterprise data products.
• Implement multi-cloud architectures across AWS and Azure.
• Integrate Databricks, Snowflake, AWS services, and Azure services.
• Build CI/CD pipelines, automation frameworks, and infrastructure-as-code provisioning.
• Implement governed access using RBAC, service principals, and enterprise identity integration.
• Mentor engineers and lead technical design.

What you'll need

• 8+ years of software, data, or platform engineering experience.
• Hands-on experience with Databricks on AWS or Azure.
• Hands-on experience with Snowflake.
• Experience with AWS services including S3, Glue, EMR, and IAM.
• Experience building cloud-based data platforms or BI and analytics solutions.
• Knowledge of distributed systems, data processing, and scalable architectures.
• Experience with CI/CD, infrastructure as code, and automation.

Nice to have

• Experience with Azure Databricks, ADLS Gen2, or AKS.
• Knowledge of Delta Lake or Apache Iceberg.
• Experience with data governance and access control models.
• Exposure to multi-cloud architecture and platform observability.
• Understanding of FinOps and cost optimization.

Details

• Location: Pune, India.