Overview
IT Developer – LLM Engineer to work on an enterprise AIOps LLM platform in a cross-functional team.
What you'll do
- Participate in a global team to design and run AIOps and LLM platform work.
- Automate provisioning, configuration, and lifecycle management of LLM runtimes and related components.
- Deploy and manage LLM configurations, embedding models, prompt templates, runtime parameters, and patching via Ansible playbooks.
- Integrate ServiceNow/First with Terraform and Ansible to automate AI platform service requests and approvals.
- Provision and operate LLM, vector, and ingestion workloads on Kubernetes (e.g., Tanzu, EKS) using IaC practices.
- Use monitoring/observability tools (SolarWinds, Prometheus, Grafana, CloudWatch where applicable) to track platform performance and health.
- Collaborate to improve platform reliability, scalability, performance, governance, and audit readiness.
What you'll need
- Experience working with AIOps and LLM platforms in an enterprise environment (stated as a support requirement).
- Hands-on automation of LLM runtimes and pipelines, embedding/vector databases, and knowledge ingestion services.
- Ability to deploy and manage LLM configurations and platform tools using Ansible playbooks.
- Ability to integrate ServiceNow/First with Terraform and Ansible.
- Knowledge of Kubernetes platforms for provisioning and operating LLM workloads using IaC practices.
- Experience using monitoring and observability toolsets listed in the posting (SolarWinds, Prometheus, Grafana, CloudWatch where applicable).
- Support backup, recovery, retention, and purge strategies for vector data and platform configurations.
Details
- Location: Nanakramguda, Hyderabad, India.
Read the full description and apply on the company’s own careers page.
