State Street logo

AI Data & Knowledge Engineer- Assistant Vice President

State Street
NewPosted today

LOCATION

Hyderabad · Onsite

EXPERIENCE

8 - 14 Years

TYPE

FullTime

SKILLS REQUIRED

Data ArchitectureData GovernanceKnowledge GraphsETL DevelopmentApache SparkVector Search

Job description

Overview

Lead the architecture and technical design of enterprise-grade data and knowledge foundations for AI systems, defining standards for reliable, governed and scalable data platforms.

What you'll do

  • Lead architecture and technical design for AI-ready data platforms, including ingestion, transformation, storage, serving and retrieval layers.
  • Define standards for scalable batch and streaming data pipelines, ETL/ELT frameworks and backend data services supporting AI applications.
  • Own data and knowledge architecture across the platform, including knowledge graphs, ontologies, semantic models and retrieval architectures.
  • Establish and enforce standards for data contracts, lineage, observability, governance and quality controls for AI systems.
  • Partner with platform, architecture and AI engineering teams to design robust integration patterns across enterprise source systems and AI services.
  • Drive adoption of modern data engineering practices, including orchestration, CI/CD for data pipelines, reusable framework components and automated quality checks.
  • Lead evaluation and implementation of technologies across big data processing, vector search, graph stores, metadata tooling and AI data infrastructure.
  • Coach and develop Officers and Senior Associates; support hiring and capability building across the pod.
  • Represent the Data/Knowledge function in architecture reviews, governance forums and cross-functional planning discussions.

What you'll need

  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.
  • 8–14 years of experience in data engineering, data architecture, platform engineering or large-scale data systems.
  • Deep expertise in building scalable data pipelines, ETL/ELT frameworks and backend data platforms.
  • Strong experience with distributed data processing technologies such as Spark, Databricks, Flink or equivalent ecosystems.
  • Experience designing enterprise data architectures across data lakes, warehouses, lakehouses and AI-serving layers.
  • Strong understanding of orchestration, observability, performance tuning, reliability engineering and cost-aware pipeline design.
  • Deep expertise in RAG, GraphRAG, knowledge graphs, ontology design, semantic modeling and metadata-driven architectures.
  • Experience owning data governance frameworks, data contracts, lineage and compliance controls at scale.
  • Proven experience leading technical teams and influencing architecture decisions across multiple domains.
  • Strong written and verbal communication skills, including the ability to present technical designs and trade-offs clearly.

Nice to have

  • Cloud certifications in AWS and/or Azure.

Details

  • Work schedule: On-premise.
  • Location: Hyderabad, India.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

AI Data & Knowledge Engineer- Assistant Vice President