AI engineer-Data Databricks Pltform

Overview

Engineer and operate the Databricks platform for enterprise-scale data, AI, and machine learning solutions. Build secure, scalable, automated capabilities for data and AI teams.

What you'll do

• Design and maintain Databricks workspaces across development, testing, and production.
• Manage Unity Catalog, clusters, SQL Warehouses, compute policies, configurations, and access controls.
• Build batch, streaming, API, database, and file-based data ingestion frameworks.
• Enable ML and generative AI workloads with MLflow, feature stores, and model serving.
• Establish CI/CD pipelines, automated testing, deployment, monitoring, and rollback processes.
• Implement security controls, governance policies, observability, and platform reliability practices.
• Provide technical guidance, participate in architecture reviews, and mentor junior engineers.

What you'll need

• 5+ years of experience in Data, Platform, or Cloud Engineering.
• 3+ years of hands-on experience with the Databricks Lakehouse Platform.
• Bachelor's or master's degree in Computer Science, Engineering, IT, or a related field.
• Expertise in Delta Lake, Unity Catalog, MLflow, Databricks Workflows, Structured Streaming, PySpark, and Spark SQL.
• Experience with Azure, AWS, or GCP cloud platforms.
• Proficiency in Python and SQL.
• Experience with Terraform and CI/CD tools such as GitHub Actions or Azure DevOps.

Nice to have

• Experience with generative AI, agentic AI, and LLM-based applications.
• Experience integrating Databricks with Snowflake and enterprise AI platforms.
• Knowledge of Kubernetes, Docker, APIs, Kafka, and event-driven architectures.
• Databricks Certified Professional or Associate certification.
• Experience supporting enterprise-scale Data and AI platforms.

Details

• Location: Bangalore, Karnataka, India.