Staff Engineer - Databricks

Overview

Lead the design, development, and optimisation of scalable data platforms and pipelines using Databricks Lakehouse and modern data and AI infrastructure patterns.

What you'll do

• Design scalable data platform architectures, pipelines, storage, and processing systems.
• Develop data models and establish data quality and governance practices.
• Build and optimise pipelines for large structured and unstructured datasets.
• Identify and resolve performance bottlenecks and complex data-platform issues.
• Evaluate emerging data technologies and improve data infrastructure.
• Implement data security measures and protect sensitive data.
• Influence product engineering designs for data, AI, and analytics use cases.

What you'll need

• 10+ years of experience in data engineering or a similar role.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• In-depth system design experience involving petabytes of data with Databricks Lakehouse.
• Experience with distributed compute, orchestration, storage, and streaming infrastructure.
• Experience with AWS, GCP, Snowflake, Airbyte, or Airflow.
• Proficiency in Python and SQL; Java or Scala may also be used.
• Experience with Kubernetes, CI/CD, infrastructure-as-code, observability, and cost optimisation.

Details

• Location: Bangalore, India.
• Legally eligible to work in India on an ongoing basis.
• Fluency in English required.