Overview
Senior Principal Data Engineer role to design, build, and operate large-scale enterprise data platforms with deep AI/ML and GenAI expertise, using AI as a first-class tool to design, build, and optimize data pipelines.
What you'll do
- Architect, build, deploy, and operate scalable ETL/ELT data pipelines supporting analytics, ML, and GenAI workloads.
- Use AI/ML and GenAI to design and build data pipelines, including AI-assisted pipeline and schema design, AI-generated and optimized transformation logic and code, automated test generation, data validation, and performance tuning, and AI-driven documentation and operational runbooks.
- Apply AI/ML techniques to automate data engineering workflows, including ingestion, schema evolution, data quality checks, anomaly detection, and pipeline optimization.
- Build and maintain feature engineering pipelines, training datasets, and feedback loops for production ML and GenAI systems.
- Enable GenAI use cases, including unstructured data ingestion, retrieval pipelines (RAG), and governance-aware AI data flows.
- Ensure enterprise standards for reliability, observability, lineage, security, and compliance across all data and AI pipelines.
- Partner with product, program, analytics, and AI teams in Agile delivery models to translate business needs into scalable AI-enabled data solutions.
- Provide senior technical leadership through architecture reviews, mentoring, and setting data and AI engineering standards.
What you'll need
- 15+ years of experience owning and operating large-scale data engineering platforms in production.
- Strong hands-on expertise in Python and SQL, with deep experience on cloud data platforms (AWS, Azure, or GCP).
- Proven experience architecting distributed, high-performance data systems.
- Demonstrated experience using AI/ML or GenAI to design, build, or optimize data pipelines (not just consuming AI outputs).
- Strong experience supporting ML/AI systems in production, including feature pipelines, data validation, monitoring, and retraining support.
- Solid understanding of data modeling, performance tuning, DevOps/CI-CD, and Agile delivery.
- Excellent communication skills and ability to operate in fast-paced, cross-functional environments.
Nice to have
- Experience with GenAI/LLM ecosystems (e.g., RAG, vector data, prompt or model lifecycle support).
- Experience with microservices, APIs, and large-scale analytics platforms.
- Prior experience leading or mentoring senior engineers (player-coach model).
- Experience working in financial services or regulated environments.
Details
- Location: Gurugram, India.
- Hybrid work model: employees are currently required to work at least 4 days in the office per week, with the flexibility to work from home 1 day a week.
Read the full description and apply on the company’s own careers page.