A

LLM Operations Engineer

Accenture
NewPosted today

LOCATION

Bengaluru · Onsite

EXPERIENCE

5+ Years

TYPE

FullTime

SKILLS REQUIRED

Large Language ModelsPrompt EngineeringRetrieval-Augmented GenerationPythonContext ManagementCI/CD

Job description

Overview

Design, build and deploy LLM-powered, agent-driven architectures that reason, collaborate and execute complex workflows across enterprise systems, while monitoring LLM performance and ensuring compliance and security in AI operations.

What you'll do

  • Design and build multi-agent AI systems capable of planning, reasoning and task execution
  • Develop applications using LLMs (GPT, Claude, Llama, etc.) with advanced prompt engineering and orchestration
  • Implement agentic workflows (planner - executor - critic - memory loops)
  • Build RAG (Retrieval-Augmented Generation) pipelines with vector databases for enterprise knowledge grounding
  • Develop tool-using agents that integrate with APIs, databases and enterprise systems
  • Architect and deploy AI copilots and autonomous assistants for business workflows
  • Optimize LLM performance using fine-tuning, prompt chaining and caching strategies
  • Implement short-term and long-term memory mechanisms (vector stores, knowledge graphs)
  • Design multi-agent collaboration protocols (hierarchical, swarm, role-based agents)
  • Deploy scalable solutions using MLOps and LLMOps practices (monitoring, evaluation, guardrails)
  • Ensure AI safety, governance and responsible AI practices

What you'll need

  • Minimum 5 years of experience is required
  • 3 to 8 years' experience in AI/ML with strong focus on Generative AI
  • Minimum 3 years of experience in Generative AI
  • Must have skills: Generative AI, Large Language Models (LLMs), Machine Learning Operations
  • 15 years full time education
  • Strong Python development skills
  • Hands-on experience with LLMs and GenAI frameworks, including OpenAI and Hugging Face Transformers
  • Hands-on experience with agent frameworks: LangChain, AutoGen, CrewAI, Semantic Kernel
  • Hands-on experience with RAG pipelines and vector DBs: FAISS, Pinecone, Weaviate
  • Experience building API-driven, tool-integrated AI agents
  • Strong understanding of prompt engineering and prompt optimization
  • Strong understanding of chain-of-thought reasoning and tool augmentation
  • Strong understanding of context management and token optimization
  • Knowledge of Docker, Kubernetes and CI/CD pipelines

Nice to have

  • Experience building multi-agent orchestration systems with role-based coordination
  • Exposure to agent planning algorithms (ReAct, Plan-and-Execute, Tree of Thought)
  • Experience with LLM evaluation frameworks (RAGAS, TruLens, Promptfoo)
  • Knowledge of graph-based reasoning and knowledge graphs
  • Building autonomous systems or copilots in enterprise environments
  • Domain experience in industrial, energy or IoT environments
  • Systems thinking for designing autonomous AI architectures
  • Strong problem decomposition for agent task design
  • Ability to balance latency, cost and accuracy in LLM systems
  • Communication with business stakeholders to translate workflows into agent pipelines
  • Innovation mindset with focus on applying agentic AI in production
  • Experience with cloud platforms (Azure OpenAI preferred, AWS/GCP acceptable)

Details

  • Based at the Pune office

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

LLM Operations Engineer