Visa logo

Senior Manager, Data Engineering

Visa
NewPosted yesterday

LOCATION

Bengaluru · Hybrid

EXPERIENCE

10 - 12 Years

TYPE

FullTime

SKILLS REQUIRED

Data EngineeringData ArchitectureData PipelinesCloud ArchitectureApache SparkApache Airflow

Job description

Overview

Senior Consultant for Visa Consulting and Analytics (VCA) Asia Pacific, based in Bangalore, to design and build reliable, scalable AI-ready data foundations that support advanced analytics, Generative AI and AI Agent solutions.

What you'll do

  • Partner with the VCA AP team to understand requirements and data challenges, and design scalable data architectures, data cubes and trusted data foundations for analytics and AI Agent use cases.
  • Work effectively across VCA Asia Pacific, global Agent build teams and testing teams; communicate technical trade-offs clearly, resolve dependencies and coordinate delivery across distributed teams.
  • Design, develop, deploy and support robust data pipelines across on-premises and cloud environments using technologies such as Hadoop, Apache Spark, Apache Airflow, Python/PySpark, SQL, AWS/Databricks frameworks and APIs.
  • Develop and deliver technical documentation, reusable patterns, test documents and promote engineering best practices.
  • Collaborate with multiple business units to understand data requirements and integrate diverse data sources to create governed, reusable and trusted data products.
  • Build the data foundations required for AI Agents, including data ingestion and transformation pipelines, metadata and lineage, retrieval pipelines, embeddings, vector indexes, secure tool and API interfaces, access controls, observability and evaluation data.
  • Apply agentic and retrieval patterns using frameworks and technologies such as LangGraph, Model Context Protocol (MCP), retrieval-augmented generation (RAG) and vector databases, working with technology, data science and application teams to productionize solutions.
  • Automate engineering, testing, deployment, monitoring and operational processes using software engineering, DevOps and CI/CD practices.
  • Ensure data solutions adhere to client-specific governance and regulatory requirements related to data privacy, security, quality and responsible AI.
  • Design target platform components, data flow architecture, orchestration patterns and capacity requirements for scalable implementation.
  • Independently manage assigned workstreams, including planning, estimation, prioritization, risks, dependencies, stakeholder communication, documentation and delivery against agreed milestones.

What you'll need

  • Bachelor's degree or higher in Computer Science, Engineering or a related field, or equivalent practical experience.
  • 10–12 years of progressive experience in data and AI engineering, data architecture and technical delivery roles.
  • Experience delivering data architecture and engineering solutions in complex, cross-functional environments, with demonstrated ability to translate ambiguous business needs into clear technical requirements and deliverable plans.
  • Demonstrated expertise in Cloud, distributed data architecture, modern data platforms and the data foundations required to support Generative AI and AI Agent solutions.
  • Good understanding of agentic AI and retrieval concepts, including LangGraph, MCP, RAG, embeddings and vector databases.
  • Excellent presentation, communication and interpersonal skills, with the ability to engage and influence global stakeholders at different organizational levels.
  • Demonstrated ability to work independently, exercise sound judgment, manage ambiguity, prioritize effectively and take end-to-end ownership of outcomes.
  • Strong resource planning, project management and delivery skills, including estimation, milestone tracking, risk and dependency management, and stakeholder reporting.
  • Demonstrated aptitude for rapid learning and adoption of emerging technologies, methodologies and engineering paradigms.
  • Advanced experience in Python/PySpark, SQL, ETL/ELT, data modelling, data streaming, Apache Airflow, APIs and cloud-based platforms such as Databricks and Snowflake.
  • Proven experience designing and developing large-scale, production-grade systems using software engineering best practices, including automated testing, DevOps, CI/CD pipelines and deployment automation.
  • Good understanding of data governance topics such as metadata management, lineage, data quality, master data management, privacy and data security management.
  • Good understanding of Agile ways of working, tools such as Jira, and practical experience working in Agile and globally distributed teams.
  • Very strong technology, stakeholder and project management skills, with the ability to lead workstreams independently.
  • Good business acumen and the ability to connect data engineering decisions to measurable market, product and business outcomes.
  • Team-oriented, collaborative, diplomatic and flexible when working across cultures, functions and time zones.
  • Detail-oriented and committed to engineering quality, reliability, security and operational readiness.
  • Able to communicate complex technical concepts, alternatives and trade-offs clearly to technical and non-technical stakeholders.
  • Demonstrates independence, accountability, sound judgment and a constructive approach to complex business and delivery challenges.
  • Exhibits intellectual curiosity and a desire for continuous learning.
  • Demonstrates integrity, maturity and commitment to Visa Values.
  • Able to influence senior management and internal stakeholders to build scalable, reusable and high-quality solutions.

Nice to have

  • Banking and Payments experience.
  • Experience with cloud data platforms and services, particularly Amazon Web Services (AWS).
  • Working knowledge of data and integration patterns for AI Agents, including LangGraph, MCP, RAG, chunking, embeddings, vector databases, metadata-aware retrieval, tool integration, access controls, observability, evaluation and failure handling.
  • Experience with API integration and deployment of containerized applications using technologies such as Docker and Kubernetes.
  • Experience operationalizing machine learning, Generative AI or AI Agent solutions using MLOps or LLMOps techniques.

Details

  • Location: Bangalore, India.
  • Visa requires at least 3 days in office, with expectations confirmed by the Hiring Manager.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Senior Manager, Data Engineering