Databricks Data Engineer - Contract-to-Hire

Overview

Databricks Data Engineer (Contract-to-Hire) to build and optimize scalable data pipelines and support migration from an on-prem SQL Server data warehouse to the Databricks Lakehouse Platform.

What you'll do

• Design, build, and optimize scalable Databricks data pipelines.
• Participate in migrating ~20TB compressed on-prem Microsoft SQL Server data warehouse to Databricks.
• Convert and modernize SQL Server tables, SSIS jobs, and SSRS/SSAS workloads for the new platform.
• Re-engineer SSIS ETL processes into Databricks notebooks, workflows, and orchestration frameworks.
• Support migration/redesign of SSAS cube-based analytics into Databricks SQL, Delta tables, and semantic models.
• Implement data quality, validation, reconciliation, and audit controls during migration.

What you'll need

• 4–7 years of overall data engineering experience.
• Hands-on Databricks data engineering experience with exposure to AI/ML features being a plus.
• Proficiency in Apache Spark (PySpark and/or Scala) and SQL.
• Experience migrating on-prem SQL Server data warehouses to cloud-based data platforms.
• Experience converting SSIS-based ETL pipelines into Spark-based solutions.
• Solid understanding of data warehousing and analytical workloads.
• Experience with Delta Lake, incremental processing patterns, and data versioning.

Nice to have

• Experience modernizing SSAS cube-based reporting solutions.
• Exposure to Databricks SQL Warehouses and BI integrations (Power BI preferred).
• Familiarity with MLflow, feature engineering, or AI-enablement within Databricks.
• Databricks certification is a plus.

Details

• Location: Pune, MH, India.