Engineer, LLM Ops

Overview

Engineer, LLM Ops enables governed, scalable, and high-quality adoption of LLM-powered solutions across the enterprise.

What you'll do

• Build and evolve LLMOps practices for reliable, secure, and scalable AI deployment.
• Manage prompt lifecycles, model configurations, and evaluation workflows.
• Run responsible AI rollout strategies using A/B testing, feature flags, and human-in-the-loop processes.
• Improve AI performance and quality using monitoring, evaluation frameworks, and continuous feedback loops.
• Embed auditability, traceability, and compliance into the LLM lifecycle to support governed adoption.
• Collaborate with AI engineers, data scientists, platform teams, and business stakeholders to productionize prototypes.

What you'll need

• 3+ years of experience in LLMOps, AI operations, software engineering, DevOps, cloud engineering, MLOps, or related roles.
• Hands-on exposure to generative AI including LLMs, prompts, RAG, and embeddings.
• Experience with Azure OpenAI or similar platforms.
• Experience with CI/CD tools including Azure DevOps and/or GitHub Actions.
• Programming experience in Python or C#/.NET.
• Bachelor’s degree or equivalent experience in a relevant field.

Details

• Location: Bangalore, India.