RBS logo

Gen AI Product Engineer

RBS
NewPosted today

LOCATION

Bengaluru · Onsite

EXPERIENCE

Not specified

TYPE

FullTime

SKILLS REQUIRED

Large Language ModelsRetrieval-Augmented GenerationPrompt EngineeringVector SearchModel Evaluation

Job description

Overview

Design, build and scale Generative AI (GenAI)-powered products and features that deliver tangible business value, bridging product thinking and engineering execution. This is a vice president level role.

What you'll do

  • Design, build and deploy production-grade GenAI products and systems that turn user and business needs into secure, scalable and reliable solutions.
  • Translate product and user requirements into scalable technical solutions, balancing model quality, latency, system complexity and long-term maintainability.
  • Build and integrate large language model (LLM) capabilities using modern frameworks and APIs, including orchestration layers, retrieval pipelines, system integrations, prompt and context engineering, and model evaluation.
  • Convert ambiguous product requirements and research concepts into robust technical architectures, balancing model capability, latency, cost, complexity and maintainability.
  • Ensure all GenAI solutions meet enterprise security, governance, responsible AI and risk management standards, with appropriate controls, escalation and mitigation built into delivery.
  • Develop and operate LLM solutions, including Retrieval-Augmented Generation (RAG) pipelines, agent workflows, orchestration, prompt and content engineering, and model integration patterns.
  • Integrate GenAI capabilities into existing platforms through internal APIs, services, event flows and data pipelines, ensuring resilience, observability and maintainability in production.
  • Define and apply approaches to model evaluation, benchmarking, monitoring and continuous optimisation to improve quality, accuracy, reliability and user outcomes.
  • Identify and manage real-world AI system failure modes, including hallucinations, retrieval failures, tool-call errors, degraded model performance, and unsafe or non-compliant outputs.
  • Support production operations, including service monitoring, incident response, root-cause analysis and on-call responsibilities where required for business-critical GenAI systems.

What you'll need

  • Proven experience designing, building and operating production-grade GenAI software systems.
  • Strong capabilities in Python, front-end design frameworks, distributed systems, API design, cloud-native engineering, observability and performance-critical workloads.
  • Experience translating ambiguous research concepts, emerging AI capabilities, user needs and product requirements into secure, scalable and maintainable production systems within fast-moving product or research-led environments.
  • Experience delivering GenAI or LLM-powered products beyond the prototype stage, including self-hosted model inference with frameworks such as vLLM, OpenAI-compatible serving patterns, orchestration layers, software development kit integration and production systems.
  • Practical understanding of LLM application architecture, including prompt and context engineering, embeddings, vector search, RAG pipelines, agent workflows, tool-calling patterns, memory and context management, and mitigation of real-world AI system failure modes.
  • Understanding of model training, fine-tuning, adaptation, inference and serving pipelines, including trade-offs in model selection, performance, cost, reliability, scalability and operational complexity.
  • Experience evaluating, monitoring and optimising AI systems, with working knowledge of responsible AI, model risk, security, governance and operational controls in enterprise or regulated environments.
  • Hands-on experience deploying small language models for latency-, cost-, privacy- or domain-specific use cases.

Details

  • Location: Bengaluru.
  • Hours: 45 per week.
  • On-call responsibilities where required for business-critical GenAI systems.
  • Job posting closing date: 24/11/2026.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Gen AI Product Engineer