Data Engineer

Overview

Data Engineer role on MerQube’s Platform Engineering team in Bangalore, focused on transforming legacy ETL into standardized cloud-native AWS data pipelines for market data and index computation.

What you'll do

• Design, build, and operate scalable AWS-based data pipelines and a lakehouse platform.
• Build and maintain large-scale ETL/ELT pipelines to ingest, normalize, and curate market, reference, and vendor data.
• Modernize legacy ETL frameworks into standardized, cloud-native AWS pipelines.
• Build data lakes and analytics-ready datasets using AWS-native services.
• Implement data quality checks, lineage, observability, and validation frameworks.
• Develop data catalogs and inventory systems for data discoverability and governance.
• Monitor production data systems, troubleshoot issues, and support on-call rotations as needed.

What you'll need

• 4–7 years of experience as a Data Engineer.
• Strong programming skills in Python and solid SQL expertise.
• Hands-on experience building batch and/or streaming ETL pipelines.
• Experience working with large, messy, heterogeneous datasets.
• Strong understanding of data modeling concepts including fact/dimension and canonical models.
• Cloud platform experience, preferably AWS (S3, Glue, Lambda, Step Functions, Athena/Redshift, CloudWatch, IAM).
• Bachelor’s Degree in Computer Science, Engineering, Mathematics, or equivalent experience.

Details

• Location: Bangalore, India.