Overview
Support day-to-day operations of the HR2030 Medallion lakehouse, ensuring reliable data ingestion, processing, and availability across Bronze, Silver, and Gold layers.
What you'll do
- Monitor Medallion pipeline schedules, execution status, dependencies, and data freshness across Bronze, Silver, and Gold layers; identify missed loads, delays, and processing failures.
- Investigate alerts and operational incidents using logs and data checks; execute approved reruns, restarts, and recovery procedures, validate results, and escalate unresolved issues against agreed service targets.
- Perform routine completeness, accuracy, duplication, and source-to-target reconciliation checks; log exceptions, coordinate remediation, and confirm data readiness for downstream consumption.
- Manage the daily support queue, prioritize requests by business impact, and perform approved data reloads, backfills, and routine maintenance following established controls and runbooks.
- Follow HR data privacy, security, access, and retention requirements; maintain execution evidence and coordinate access requests through approved processes.
- Support operational readiness checks, testing, and deployment validation for pipeline changes; confirm monitoring, support documentation, recovery procedures, and handover are in place.
- Work with source-system owners, engineering teams, and data-product consumers to resolve feed issues, schema changes, and dependency failures; communicate expected recovery times and business impacts.
- Maintain daily service-health updates, incident records, and shift handovers for India/US teams; track pipeline success, data freshness, incident ageing, resolution times, and recurring issues.
- Support root-cause analysis, implement approved corrective actions, automate repeatable checks, and identify performance and resource-usage improvements to reduce recurring incidents and manual effort.
What you'll need
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, Analytics, Business Analytics, Engineering, or a related field.
- 5+ years of experience in data engineering, data-platform operations, production support, or a related discipline, including hands-on support of scheduled data pipelines.
- Experience monitoring and troubleshooting production ingestion and transformation pipelines, managing dependencies, and validating recovery from failed or delayed processing.
- Strong SQL skills and working proficiency in Python or a comparable scripting language for troubleshooting, reconciliation, and automation of operational checks.
- Practical understanding of lakehouse and Medallion architecture, including Bronze, Silver, and Gold processing, incremental loads, schema changes, and data-quality controls.
- Experience with incident, problem, and change management; ability to prioritize by business impact, follow runbooks, maintain support records, and work against agreed service targets.
- Strong written and verbal communication skills, with the ability to explain service impacts, provide clear incident updates, and document troubleshooting and recovery procedures.
- Demonstrated collaboration, attention to detail, accountability, and ability to work across global teams and time zones.
Nice to have
- Experience with cloud data platforms, pipeline orchestration and monitoring tools, version control, and controlled deployments.
- Familiarity with HR data privacy and security requirements.
Details
- Location: Bangalore, India (On-site/Hybrid).
- Reports to: IT Director, D&I Program Leader.
- Works across India/US teams and global time zones.
Read the full description and apply on the company’s own careers page.