LLM Operations Engineer

Overview

Deploy, monitor, and maintain scalable large language model operations using cloud-native platforms. The role focuses on operational reliability, performance, security, and compliance for AI services.

What you'll do

• Deploy large language models using cloud-native services and tools.
• Monitor model performance and resolve operational issues.
• Collaborate with stakeholders to translate requirements into deployment strategies.
• Improve operational workflows for efficiency and reliability.
• Document operational procedures and incident resolutions.
• Guide junior team members on operational best practices.

What you'll need

• At least 3 years of experience in Generative AI.
• Proficiency in Generative AI.
• Proficiency in Machine Learning Operations.
• Proficiency in Large Language Models and Agentic AI.
• Experience with cloud-native platforms and container orchestration tools.
• Knowledge of monitoring, performance tuning, security, and compliance for AI operations.
• 15 years of full-time education.

Details

• Location: Hyderabad.