Senior Data Engineer

Overview

Senior Data Engineer leading the design, architecture, and implementation of scalable, reliable end-to-end data systems.

What you'll do

• Design and implement stable, scalable data pipelines for cleansing, structuring, and integrating big data for analysis and targeting.
• Improve data architecture, data quality, monitoring, and data availability with collaboration on new data sources.
• Develop and lead a comprehensive data quality framework for delivery of high-quality data to stakeholders.
• Maintain an enterprise-wide data dictionary.
• Define, architect, and implement monitoring and alerting policies for mission-critical data solutions.

What you'll need

• 5+ years of demonstrated experience with SQL.
• Demonstrated experience with Python, particularly PySpark on Databricks.
• Demonstrated experience with CI/CD systems.
• Experience with large data sets and distributed computing (Spark/Hive/Hadoop).
• Expertise in Databricks for large-scale data processing, platform optimization, and pipeline orchestration.
• Experience designing fault-tolerant, fault-resilient systems for high availability and reliability.

Details

• Location: Bangalore, Karnataka, India.