LLM Operations Engineer

Overview

As an LLM Operations Engineer, you will deploy and manage large language models using cloud-native services and tools. You will monitor model performance, address operational challenges, ensure compliance and security standards, and contribute to enterprise-grade Generative and Agentic AI solutions.

What you'll do

• Utilize cloud-native services and tools for scalable and efficient deployment.
• Monitor the performance of large language models.
• Address operational challenges affecting AI operations.
• Ensure AI operations comply with established compliance and security standards.
• Perform independently and become an SME.
• Participate actively and contribute to team discussions.
• Contribute solutions to work-related problems.
• Assist in developing and implementing best practices for LLM operations.
• Collaborate with cross-functional teams to identify and resolve operational issues.
• Design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks.
• Apply Generative and Agentic AI to address complex business challenges, automate processes, and integrate intelligent insights into enterprise workflows.
• Lead AI-driven solution design and delivery.

What you'll need

• Minimum 3 year(s) of experience.
• Minimum 3 years of experience in Large Language Models.
• 15 years full time education.
• Proficiency in Large Language Models.
• Strong understanding of AI operational compliance and security standards.
• Familiarity with performance monitoring tools and techniques.
• Experience in troubleshooting and optimizing AI model performance.
• Strong grasp of Generative and Agentic AI, prompt engineering, and AI evaluation frameworks.
• Ability to align AI capabilities with business objectives while ensuring scalability, responsible use, and tangible value realization.

Nice to have

• Experience with cloud-native services and tools.

Details

• This position is based at the Bengaluru office.