Databricks Data Engineer - Bengaluru

Overview

Data engineer joining the team that builds and operates Omnissa’s Enterprise Data Lakehouse as an individual contributor.

What you'll do

• Build and operate end-to-end data pipelines on the Lakehouse across AWS and Databricks.
• Design and develop dashboards and reports for technical and business audiences in Tableau/Superset.
• Write efficient, scalable, secure SQL and Python using Databricks (Spark) and federated engines.
• Model and manage data in open table formats like Apache Iceberg and Delta Lake.
• Orchestrate workflows with Apache Airflow and Databricks Workflows; deploy via GitHub Actions CI/CD.
• Apply data governance, quality, and metadata practices using Unity Catalog and/or Alation.
• Prepare data foundations to support AI/GenAI initiatives such as RAG and agentic use cases.

What you'll need

• 2–5 years of experience in Data Engineering & Analytics.
• Strong proficiency in SQL and Python.
• Hands-on experience with Apache Spark for pipeline development.
• Experience with large datasets via Starburst/Trino/AWS Athena.
• Exposure to AWS data stack including S3, Glue, Athena, and EMR.
• Experience with Apache Airflow.
• CI/CD experience with GitHub Actions.

Nice to have

• GenAI/LLM awareness including RAG patterns, embeddings/vector stores, and agentic frameworks.

Details

• Location: Bengaluru, India.