Overview
Define and drive enterprise-scale data architecture using Databricks Lakehouse, Snowflake, Apache Iceberg, and modern cloud-native technologies. Lead architecture decisions, platform strategy, governance frameworks, and modernization initiatives as an individual contributor.
What you'll do
- Define enterprise data platform architecture and roadmap.
- Design scalable Lakehouse and Data Mesh architectures.
- Establish standards, patterns, and governance frameworks.
- Lead modernization and migration strategies.
- Architect solutions using Databricks, Snowflake, Iceberg, and cloud services.
- Design multi-cloud and hybrid-cloud data ecosystems.
- Define data sharing and interoperability strategies.
- Enable AI/ML and GenAI workloads on modern data platforms.
- Develop metadata, catalog, lineage, and governance solutions.
- Design enterprise-scale security and compliance frameworks.
- Establish platform observability and FinOps practices.
- Optimize storage and compute costs.
- Conduct architecture reviews and technical assessments.
- Define reference architectures and reusable frameworks.
- Drive NFRs including scalability, resiliency, security, and performance.
- Collaborate with business, product, security, and engineering leaders.
- Present architecture recommendations to executive stakeholders.
- Lead multiple delivery teams across strategic programs.
- Mentor architects, leads, and engineering teams.
What you'll need
- B.Tech degree, MTech, or MCA with a computer science background, or equivalent experience.
- 10+ years of total experience.
- Minimum 3 years of relevant experience in Databricks.
- Proven experience architecting enterprise-scale Data Lakehouse and Data Platform solutions using Databricks and Snowflake.
- Deep expertise in Cloud Architecture across AWS, Azure, or GCP, including security, governance, scalability, and resiliency frameworks.
- Extensive experience defining enterprise data strategies, modernization roadmaps, and migration approaches.
- Strong knowledge of Apache Iceberg, Delta Lake, metadata management, and Data Mesh architectures.
- Experience designing multi-cloud and hybrid-cloud data ecosystems supporting analytics, AI/ML, and GenAI workloads.
- Proven leadership in defining architecture standards, governance models, and reference architectures.
- Expertise in cost optimization, performance engineering, and cloud FinOps implementation.
- Experience influencing executive stakeholders and leading architecture reviews across multiple programs.
- Excellent communication, presentation, and strategic decision-making skills.
- Expert knowledge of Databricks, including Lakehouse Architecture, Delta Lake, Unity Catalog, Workflows, and Performance Optimization.
- Strong proficiency in Python, PySpark, Spark SQL, and distributed data processing.
- Extensive hands-on experience with Snowflake, including Snowpipe, Streams, Tasks, Data Sharing, and Query Optimization.
- Strong expertise in Apache Iceberg, open table formats, schema evolution, partitioning, and time-travel capabilities.
- Experience designing and implementing large-scale Data Engineering and ETL/ELT Pipelines.
- Hands-on experience with AWS, Azure, or GCP cloud-native data services.
- Strong SQL and data modeling skills across OLTP and analytical environments.
- Experience with Real-Time Data Processing using Kafka, Event Hubs, Kinesis, or Pub/Sub.
- Knowledge of Data Governance, Metadata Management, Data Quality, and Security frameworks.
Nice to have
- Experience with Terraform, CloudFormation, or Infrastructure as Code (IaC).
- Knowledge of Docker, Kubernetes, and containerized data platforms.
- Experience with CI/CD tools such as GitHub Actions, Jenkins, Azure DevOps, or GitLab.
- Exposure to AI/ML, MLOps, and GenAI data platform integration.
- Knowledge of Data Mesh, Data Fabric, and modern enterprise data architectures.
Details
- Employment type: Full-time employee.
- Location: Bangalore (BGM/GGN); ATS location: Bengaluru, Karnataka, India.
- Business platform: EDA Platform.
- Individual contributor role, not a people manager.
Read the full description and apply on the company’s own careers page.