Senior Associate – Data Engineer Databricks, Advisory

Overview

Design, build, and operate scalable data pipelines on the Databricks Lakehouse Platform. The role supports analytics, AI/ML, reporting, and downstream data use cases.

What you'll do

• Design and maintain end-to-end Databricks data pipelines.
• Implement batch and incremental processing with Delta Lake.
• Develop and optimize Databricks notebooks, jobs, and workflows.
• Ingest, transform, and curate structured and semi-structured datasets.
• Optimize Spark jobs for performance and cost efficiency.
• Provide production support and troubleshoot pipeline issues.
• Mentor junior engineers and contribute to best practices.

What you'll need

• 3 to 8 years of experience as a Data Engineer.
• Strong Databricks, Apache Spark, PySpark, and Spark SQL experience.
• Strong knowledge of Delta Lake and Lakehouse architecture.
• Advanced SQL skills.
• Experience with ETL/ELT patterns and data warehousing.
• Exposure to Azure, AWS, or GCP.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field with 60% or above.

Nice to have

• Experience with Unity Catalog and data governance.
• Exposure to Auto Loader or streaming frameworks.
• CI/CD experience for data pipelines.
• Python experience for data engineering and automation.
• Databricks Associate or Professional certification.

Details

• Location: Gurugram, Haryana, India.
• Visa sponsorship is not available.
• Government clearance is not required.