Overview
Manager – AI Engineer in PwC's Advisory line of service, Data, Analytics & AI specialism, designing and operating ML and LLM systems for clients.
What you'll do
- Design ML pipelines for experiment management, model management, feature management, and model retraining.
- Design APIs for model inferencing at scale.
- Architect distributed training and serving of large language models, using model and data parallel training with frameworks such as DeepSpeed and service frameworks such as vLLM.
- Fine-tune and optimise models to achieve better latencies and accuracies and to reduce training and resource requirements for LLM and LVM models.
- Apply DevOps and LLMOps practices, including Kubernetes, Docker and container orchestration.
- Work with LLM orchestration frameworks such as Flowise, Langflow and Langgraph.
What you'll need
- Bachelor of Technology degree, or MCA, BCA or M.Tech (degree and field of study as listed in the ad).
- 5 to 10 years of years of experience (the ad states 5-8 years and 5 to 10 years).
- Mandatory skills: Gen AI, LLM, Hugging Face, Python, PyTorch/TensorFlow/Keras, LangChain, LangGraph, Docker, Kubernetes.
- Proven expertise with MLflow, SageMaker, Vertex AI and Azure AI.
- Deep knowledge of GPU architectures.
- Expertise in distributed training and serving of large language models.
- Proven expertise in model fine-tuning and optimisation techniques.
- Proven expertise in DevOps and LLMOps practices.
- Required skill: Project Management.
Nice to have
- Cloud certifications (bonus): AWS Professional Solution Architect, AWS Machine Learning Specialty, Azure Solutions Architect Expert.
Details
- Location: Chennai - Menon Eternity.
- Visa sponsorship: No.
- Government clearance required: No.
- Job posting end date: September 20, 2026.
Read the full description and apply on the company’s own careers page.