LLM Operations Engineer

Overview

As an LLM Operations Engineer, deploy large language models using cloud-native platforms and tools, monitor model performance, resolve operational issues, and ensure compliance and security in AI operations.

What you'll do

• Utilize cloud-native services and tools for scalable and efficient deployment of large language models.
• Monitor LLM performance and identify and resolve operational issues.
• Ensure AI operations adhere to compliance and security protocols.
• Collaborate with cross-functional teams to maintain smooth functioning of AI systems.
• Proactively address operational challenges.
• Perform independently and become an SME.
• Participate actively and contribute to team discussions.
• Contribute solutions to work-related problems.
• Collaborate with stakeholders to optimize deployment workflows and improve operational efficiency.
• Document best practices and operational procedures to support team knowledge sharing.
• Support junior team members by providing guidance and sharing expertise to foster professional growth.
• Monitor and troubleshoot large-scale AI systems to maintain high availability and performance.
• Analyze operational data to identify trends and implement improvements.

What you'll need

• Minimum 3 year(s) of experience is required.
• Minimum 3 years of experience in Generative AI.
• 15 years full time education.
• Proficiency in Generative AI.
• Proficiency in Machine Learning Operations.
• Proficiency in Large Language Models (LLMs).
• Proficiency in Agentic AI.
• Strong understanding of cloud-native services and their application in AI model deployment.
• Experience in monitoring and troubleshooting large-scale AI systems to maintain high availability and performance.
• Familiarity with security and compliance standards relevant to AI operations.
• Ability to analyze operational data to identify trends and implement improvements.

Details

• This position is based at the Pune office.