Senior Data Engineer

Overview

Senior Data Engineer to design, build, and maintain scalable, reliable data pipelines and data products for quality, observability, and monitoring.

What you'll do

• Design, develop, and maintain high-capacity, scalable data pipelines.
• Build API-based ETL/ELT processes for raw data collection from multiple sources.
• Create data products across the release cycle, including KPI dataset curation.
• Implement data quality and observability layers with validation, lineage, and performance monitoring.
• Develop CI/CD build and deployment processes using Jenkins, Docker, and Git.
• Define monitoring and alerting for data solutions.

What you'll need

• 5+ years of hands-on Python experience.
• 4+ years with Databricks.
• 5+ years using advanced SQL queries, including optimizing efficient SQL.
• 2+ years integrating with 3rd-party APIs.
• 2+ years working in AWS environments.
• Bachelor’s degree or equivalent in an engineering/technical field.

Details

• Location: Bangalore, Karnataka, India.