LLM Operations Engineer

Overview

Design, deploy, and operate Generative AI and multi-agent systems that support autonomous enterprise workflows. The role focuses on LLM operations, agent orchestration, monitoring, evaluation, and responsible AI practices.

What you'll do

• Design multi-agent systems for planning, reasoning, and task execution.
• Develop LLM applications with prompt engineering and orchestration.
• Build RAG pipelines using vector databases and enterprise knowledge.
• Develop tool-using agents integrated with APIs, databases, and enterprise systems.
• Deploy AI copilots and autonomous assistants for business workflows.
• Optimize LLM performance through fine-tuning, prompt chaining, and caching.
• Implement monitoring, evaluation, guardrails, safety, and governance practices.

What you'll need

• 3–8 years of experience in AI/ML focused on Generative AI.
• Strong Python development skills.
• Experience with LLMs, Generative AI frameworks, and agent frameworks.
• Experience building RAG pipelines and working with vector databases.
• Experience with API-driven, tool-integrated AI agents.
• Experience with cloud platforms and knowledge of Docker, Kubernetes, and CI/CD.
• 15 years of full-time education.

Details

• Location stated in additional information: Pune office.