Overview
Design, build and scale Generative AI (GenAI)-powered products and features that deliver tangible business value, bridging product thinking and engineering execution. This is a vice president level role.
What you'll do
- Design, build and deploy production-grade GenAI products and systems that turn user and business needs into secure, scalable and reliable solutions.
- Translate product and user requirements into scalable technical solutions, balancing model quality, latency, system complexity and long-term maintainability.
- Build and integrate large language model (LLM) capabilities using modern frameworks and APIs, including orchestration layers, retrieval pipelines, system integrations, prompt and context engineering, and model evaluation.
- Convert ambiguous product requirements and research concepts into robust technical architectures, balancing model capability, latency, cost, complexity and maintainability.
- Ensure all GenAI solutions meet enterprise security, governance, responsible AI and risk management standards, with appropriate controls, escalation and mitigation built into delivery.
- Develop and operate LLM solutions, including Retrieval-Augmented Generation (RAG) pipelines, agent workflows, orchestration, prompt and content engineering, and model integration patterns.
- Integrate GenAI capabilities into existing platforms through internal APIs, services, event flows and data pipelines, ensuring resilience, observability and maintainability in production.
- Define and apply approaches to model evaluation, benchmarking, monitoring and continuous optimisation to improve quality, accuracy, reliability and user outcomes.
- Identify and manage real-world AI system failure modes, including hallucinations, retrieval failures, tool-call errors, degraded model performance, and unsafe or non-compliant outputs.
- Support production operations, including service monitoring, incident response, root-cause analysis and on-call responsibilities where required for business-critical GenAI systems.
What you'll need
- Proven experience designing, building and operating production-grade GenAI software systems.
- Strong capabilities in Python, front-end design frameworks, distributed systems, API design, cloud-native engineering, observability and performance-critical workloads.
- Experience translating ambiguous research concepts, emerging AI capabilities, user needs and product requirements into secure, scalable and maintainable production systems within fast-moving product or research-led environments.
- Experience delivering GenAI or LLM-powered products beyond the prototype stage, including self-hosted model inference with frameworks such as vLLM, OpenAI-compatible serving patterns, orchestration layers, software development kit integration and production systems.
- Practical understanding of LLM application architecture, including prompt and context engineering, embeddings, vector search, RAG pipelines, agent workflows, tool-calling patterns, memory and context management, and mitigation of real-world AI system failure modes.
- Understanding of model training, fine-tuning, adaptation, inference and serving pipelines, including trade-offs in model selection, performance, cost, reliability, scalability and operational complexity.
- Experience evaluating, monitoring and optimising AI systems, with working knowledge of responsible AI, model risk, security, governance and operational controls in enterprise or regulated environments.
- Hands-on experience deploying small language models for latency-, cost-, privacy- or domain-specific use cases.
Details
- Location: Bengaluru.
- Hours: 45 per week.
- On-call responsibilities where required for business-critical GenAI systems.
- Job posting closing date: 24/11/2026.
Read the full description and apply on the company’s own careers page.