Data Engineer

Overview

Design, build and optimize scalable data pipelines and analytics solutions within the automotive domain, working with large datasets, cloud platforms and visualization tools to support data-driven decisions across engineering and business teams.

What you'll do

• Design, build and optimize ETL/ELT pipelines using PySpark and Databricks for large-scale automotive datasets.
• Implement and maintain CI/CD pipelines for automated data workflows.
• Work with Azure Data Lake, Azure Synapse, Azure Data Factory and Databricks for data ingestion, transformation and processing.
• Perform statistical analysis, build predictive models and identify trends in vehicle test drive behavior, environmental conditions and key performance indicators.
• Develop interactive Power BI dashboards using DAX, KPIs and real-time analytics for engineering and business stakeholders.
• Collaborate with data scientists, software engineers and product stakeholders, and maintain clear, structured documentation of data flows and processes.

What you'll need

• Strong experience with PySpark, Databricks and distributed data processing.
• Hands-on expertise in Azure data services (ADLS, ADF, Synapse).
• Proficiency in SQL, Python and data modeling.
• Experience building dashboards in Power BI using DAX.
• Understanding of CI/CD processes and DevOps practices for data engineering.

Nice to have

• Automotive domain experience.
• Knowledge of machine learning workflows.
• Familiarity with Delta Lake, Unity Catalog and data governance best practices.

Details

• Location: Bangalore, India.