Lead Data Engineer - PySpark/SQL/AI

Overview

Lead Data Engineer role focused on modernizing enterprise HR data platforms and scaling cloud-native, AI-enabled data engineering capabilities.

What you'll do

• Lead complex initiatives and participate in large-scale software planning for Technology.
• Design, develop, and run tooling to discover data and application problems and report issues to engineering and product leadership.
• Review and analyze software enhancement initiatives for business, operational, or technical improvements.
• Make decisions in complex data engineering situations involving software options and compliance requirements.
• Collaborate with internal partners to resolve highly risky data engineering challenges.
• Modernize large-scale legacy data ecosystems into scalable, cloud-native, AI-enabled platforms.

What you'll need

• 5+ years of Database Engineering experience (or equivalent via work, training, military, or education).
• 5–10+ years of experience in Data Engineering and Enterprise Data Platforms.
• 5+ years leading enterprise-scale data modernization initiatives.
• Hands-on expertise with Python, Apache Spark/PySpark, and SQL.
• Hands-on experience with ETL/ELT design and API integration.
• Deep understanding of lakehouse and medallion architecture concepts.

Details

• Location: Hyderabad, India.