Data Engineer - II (Biometrics)

Overview

Data Engineer II focused on designing, building, and scaling AWS data pipelines that support ML systems, dataset creation, benchmarking, and production workflows.

What you'll do

• Design, build, and maintain data pipelines for dataset creation, transformation, and benchmarking.
• Own and optimize Airflow pipelines on AWS for data processing, orchestration, and evaluation workflows.
• Write production-grade SQL and Python for large-scale data processing and analysis.
• Collaborate with ML engineers on model training, evaluation, and benchmarking pipelines.
• Improve pipeline performance, reliability, and observability to ensure high data quality.
• Build systems for model performance tracking and data drift monitoring.
• Troubleshoot data issues across pipelines with minimal impact to ML workflows.

What you'll need

• 3–5 years of experience in Data Engineering, Data Platforms, or related roles.
• Strong proficiency in Python and SQL for production systems.
• Hands-on experience with AWS services including S3, EC2, SageMaker (or similar).
• Experience building and managing Airflow (or similar orchestration tools).
• Strong data engineering fundamentals (ETL/ELT, data modeling, pipeline design).
• Experience with large-scale datasets and distributed data systems.
• Experience supporting ML workflows, datasets, or evaluation pipelines.

Nice to have

• Experience with ML infrastructure, MLOps, or model evaluation workflows.
• Exposure to biometric systems or computer vision datasets.
• Familiarity with data quality frameworks, monitoring, and observability tools.
• Experience working in SaaS or high-scale production environments.

Details

• Location: Bangalore.