AI Data Engineer II

Overview

AI Data Engineer II role focused on building and supporting scalable data pipelines and cloud-based data solutions, with opportunities to work on AI and Generative AI use cases.

What you'll do

• Develop and maintain ETL/ELT data pipelines for batch processing and analytics.
• Build data transformation solutions using Python, PySpark, and SQL.
• Ingest, transform, and curate datasets using Databricks.
• Integrate data from relational databases, APIs, files, and cloud storage.
• Validate, reconcile, and perform quality checks for migrated and processed data.
• Support dataset and pipeline migration to modern cloud-based platforms.
• Troubleshoot pipeline failures, performance issues, and data quality problems.

What you'll need

• 2–5 years of experience in data engineering/data analytics engineering or related roles.
• Hands-on experience with Python.
• Strong working knowledge of SQL.
• Experience with Spark/PySpark for data processing.
• Hands-on experience with Databricks or a similar cloud data processing platform.
• Experience developing and maintaining ETL/ELT pipelines.
• Experience with structured and semi-structured data (CSV, JSON, Parquet).

Details

• Location: Bangalore, INKA, India.