Manager, Data Engineering

Overview

Lead a team of data engineers to design, develop and optimize scalable data pipelines and infrastructure, with end-to-end accountability for data products at Vanguard India's Hyderabad technology center.

What you'll do

• Hire, mentor and manage a team of data engineers, fostering innovation, collaboration and continuous learning in data engineering best practices.
• Design, develop and maintain scalable ETL pipelines to process and integrate structured and unstructured data from multiple sources.
• Build and maintain scalable, fault-tolerant data architectures for efficient storage, retrieval and processing across cloud and on-premises environments.
• Oversee design, implementation and performance tuning of relational and NoSQL databases, ensuring consistency, security and accessibility.
• Automate data ingestion, transformation and validation to improve pipeline efficiency and reduce manual intervention.
• Develop cloud-based data solutions on AWS, Azure or Google Cloud using technologies such as Spark, Hadoop and Kafka.
• Work closely with data scientists, analysts and business intelligence teams to understand data requirements and deliver scalable analytics and reporting solutions.
• Proactively monitor data pipelines and systems, troubleshoot failures and implement preventive measures for reliability.
• Partner with business and IT leaders to align data engineering initiatives with company goals.
• Lead, coach and develop high-performing data and technology teams, including hiring, performance management, workforce planning and talent development.
• Drive delivery of strategic initiatives across data engineering, data warehousing, data lakes and lakehouses, data integration, data governance, data quality, analytics and business intelligence.
• Partner with business, product, architecture and engineering stakeholders to translate priorities into product roadmaps, delivery plans and measurable outcomes.
• Lead product-oriented teams with end-to-end accountability for development, delivery, maintenance, production support, reliability and continuous improvement of data products.
• Drive Agile practices, including intake management, backlog prioritization, estimation, sprint and release planning, and delivery governance.
• Manage capacity planning, resource forecasting, delivery commitments, risks, issues and cross-team dependencies.
• Leverage AI-enabled tools to improve productivity, automate workflows and accelerate responsible AI adoption across the team.
• Ensure data solutions are scalable, secure, reliable, reusable and compliant with applicable technology, risk, privacy and information security standards.
• Promote data governance, data quality, metadata management, lineage, ownership and stewardship practices.
• Monitor delivery, quality and operational health through relevant metrics, and provide clear updates to stakeholders and leadership.
• Foster strong stakeholder relationships and communicate complex data and technology topics to technical and non-technical audiences.
• Promote automation, standardization, engineering excellence, cost optimization and modern data practices, including cloud and AI-enabled capabilities.
• Provide leadership during major incidents and critical production events, driving timely resolution, stakeholder communication and service recovery.

What you'll need

• Minimum 8 years of relevant work experience, with at least 5 years in a leadership role managing data engineering teams and large-scale data infrastructure.
• Bachelor's degree (B.E./B.Tech) in Computer Science, IT or a related field, or a Diploma in Data Science/Data Engineering.
• Strong expertise in ETL development, data warehousing and real-time data processing frameworks.
• Hands-on experience with SQL, Python, Spark, Kafka and cloud platforms (AWS, Azure, Google Cloud).
• Proficiency in database technologies (PostgreSQL, MySQL, MongoDB, Snowflake, BigQuery) and distributed computing frameworks.
• Proven experience leading teams in a product-based environment with responsibility for delivery execution and stakeholder management.
• Strong understanding of Agile delivery practices, backlog management, sprint planning and Jira.
• Experience leading data-focused technology initiatives, including data engineering, analytics, data quality, governance or modern data platforms.
• Strong people leadership, coaching and talent development skills.
• Excellent stakeholder management, communication and influencing abilities.
• Demonstrated ability to drive execution, manage ambiguity, solve complex problems and lead organisational change.
• Ability to understand technical concepts and effectively partner with engineering teams to deliver business outcomes.

Nice to have

• Experience in financial services or other highly regulated industries.
• Exposure to cloud-based data platforms and AI-enabled technology initiatives.
• Agile, Scrum, PMP, SAFe or related certifications.
• Experience leading cloud data platform, data modernization or platform transformation initiatives.

Details

• Location: Hyderabad, Telangana, India (Vanguard India).
• Only qualified external applicants will be considered.
• Hybrid working model for most employees.