Manager – AI Architect, Advisory

Overview

Manager-level AI Architect role in PwC's Advisory line of service, Data, Analytics & AI specialism, designing and deploying ML and LLM systems for clients.

What you'll do

• Design ML pipelines for experiment management, model management, feature management, and model retraining.
• Design APIs for model inferencing at scale.
• Design and implement distributed training and serving of large language models.
• Apply model and data parallel training using frameworks such as DeepSpeed and service frameworks such as vLLM.
• Fine-tune and optimise models to achieve better latencies and accuracies.
• Reduce training and resource requirements for fine-tuning LLM and LVM models.
• Apply DevOps and LLMOps practices, including Kubernetes, Docker and container orchestration.
• Use LLM orchestration frameworks such as Flowise, Langflow and Langgraph.

What you'll need

• 3+ years of experience required.
• Degree: Master of Business Administration (MBA) required; the ad also lists BE/B.Tech/MBA/MCA as education qualifications.
• Proven expertise with MLflow, SageMaker, Vertex AI and Azure AI.
• Deep knowledge of GPU architectures.
• Expertise in distributed training and serving of large language models.
• Proficiency in model and data parallel training using DeepSpeed and vLLM.
• Proven expertise in model fine-tuning and optimisation techniques.
• Proven expertise in DevOps and LLMOps practices.
• Knowledge of Kubernetes, Docker and container orchestration.
• Deep understanding of LLM orchestration frameworks such as Flowise, Langflow and Langgraph.
• Mandatory skills: Gen AI, LLM, Hugging Face, Python, PyTorch/TensorFlow/Keras, LangChain, LangGraph, Docker, Kubernetes.
• Proficient in Python, SQL and JavaScript.
• Required skill: JavaScript Object Notation (JSON).

Nice to have

• Preferred skill sets: SQL, machine learning, data science.
• Cloud certifications (bonus): AWS Professional Solution Architect, AWS Machine Learning Specialty, Azure Solutions Architect Expert.

Details

• Location: Bengaluru Millenia.
• Visa sponsorship: not offered.
• Government clearance: not required.
• Job posting end date: October 27, 2026.