AI Lead Data Engineer

Overview

AI Lead Data Engineer responsible for designing and implementing scalable data pipelines and systems across multiple domains, and leading end-to-end ownership of components.

What you'll do

• Lead design and implementation of scalable data pipelines and systems for complex, cross-domain problems.
• Contribute to system architecture and technical proposals aligned with enterprise standards.
• Own components end-to-end, including design, implementation, testing, deployment, and operations.
• Define and track SLAs and support operational reliability of owned components.
• Mentor engineers and drive knowledge sharing through code reviews, talks, and training.
• Facilitate cross-team technical discussions and guide technical alignment across squads.
• Evaluate technologies and anticipate future scalability and security challenges.

What you'll need

• 10+ years of experience in data/software engineering, including owning complex cross-domain projects at scale.
• Extensive experience building and maintaining scalable data pipelines using Apache Spark, Kafka, and Airflow.
• Expertise in cloud data platforms using AWS, GCP, or Azure, including distributed systems and managed services.
• Solid understanding of end-to-end data systems from ingestion through machine learning model deployment and inference.
• Expertise in data security, data governance, and industry compliance regulations.
• At least 5 years in a technical leadership role, including database design and data engineering methodologies.
• Proven ability to mentor and guide engineers and facilitate technical discussions to drive consensus.

Details

• Location: Pune, India.