Senior Technical Consultant (Data Engineer) - RDAF

Overview

Senior Technical Consultant (Data Engineer) responsible for designing and delivering data ingestion, transformation, validation, and publishing pipelines for manufacturing (MFG) data flows.

What you'll do

• Design and implement data ingestion and transformation pipelines.
• Manage data ingestion, transformation, validation, and publishing activities.
• Review customer-provided data to understand technical/functional intent and dependencies.
• Build and maintain ingestion and egress pipelines for large data volumes.
• Integrate data from multiple sources via API or batch integrations.
• Support production deployment and conduct issue triage, testing, and root-cause analysis.
• Provide technical guidance to junior consultants and review their code.

What you'll need

• 3+ years of experience in Data Architecture, Data Engineering, or related fields.
• Strong experience in data modelling, ETL processes, and cloud-based data platforms.
• Hands-on experience with Python, PySpark, and SQL.
• Experience with workflow management tools such as Airflow and SSIS.
• Experience with Parquet, JSON, RESTful APIs, HDFS, Delta Lake, and query frameworks like Hive and Presto.
• Strong SQL skills for query writing and relational databases.
• Version control experience with GitHub or Azure DevOps.

Details

• Location: Bangalore, Karnataka, India.