Veralto logo

AI Operations Engineer

Veralto
NewPosted today

LOCATION

Bangalore · Onsite

EXPERIENCE

3+ Years

TYPE

FullTime

SKILLS REQUIRED

ObservabilityCI/CDInfrastructure as CodeCloud ComputingCloud SecurityIncident Response

Job description

Overview

Reporting to the Head of AI, the AI Operations Engineer deploys, operates and continuously improves the infrastructure supporting AI applications, agentic systems and machine learning workloads, combining DevOps, MLOps and LLMOps to make AI delivery repeatable, secure, observable, reliable and cost-effective.

What you'll do

  • Build and operate Azure infrastructure, containerized services, networking, storage, model-serving environments and agentic workflows using infrastructure as code and reusable modules.
  • Automate CI/CD pipelines for AI services, models, prompts and configurations, including testing, evaluation gates, versioning, staged deployment, traceability and rollback.
  • Implement production observability through dashboards, logging, tracing, alerts, service-level objectives, and monitoring of reliability, quality, latency, token usage and cost.
  • Improve operational resilience by troubleshooting failures, managing quotas and rate limits, conducting load and capacity tests, validating backup and recovery procedures, and participating in incident response and root-cause analysis.
  • Apply security and governance controls such as identity and access management, secrets handling, least-privilege access, tenant isolation, data-retention controls, sensitive-data protection and audit logging.
  • Provide reproducible development and evaluation environments, maintain operational documentation and runbooks, support retrieval pipelines and agent workflows, and contribute reusable DevOps tooling across engineering.

What you'll need

  • 3+ years of experience in DevOps, cloud infrastructure, platform engineering, site reliability engineering, or equivalent practical experience.
  • Hands-on experience operating production services on Microsoft Azure.
  • Experience deploying or supporting at least one production AI or machine learning service.
  • Strong foundations in Linux, networking, containers, Git-based workflows, infrastructure as code and CI/CD.
  • Working proficiency in Python and familiarity with shell scripting.
  • Practical experience with Terraform or Bicep.
  • Practical experience with GitHub Actions or Azure Pipelines.
  • Practical experience with production monitoring, logging, tracing, alerting, incident troubleshooting and cloud cost management.
  • Understanding of secure deployment practices, including identity and access management, secrets handling, tenant isolation and sensitive-data protection.
  • Ability to work independently and collaborate across AI, engineering, platform and security teams.

Nice to have

  • Experience operating AI-enabled enterprise SaaS products or agentic applications in production, particularly on Azure.
  • Experience with Kubernetes or Azure managed container services, model-serving platforms, LLM observability, evaluation pipelines, model registries, experiment tracking, or model and dataset versioning.
  • Experience supporting retrieval systems, vector databases, fine-tuning pipelines, GPU workloads, enterprise data governance, or the food, beverage and supplements industry.

Details

  • Location: based in India (Bangalore, Karnataka).
  • Contributes to shared DevOps improvements across engineering.
  • Employment is subject to applicable work-authorization and background-screening requirements.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

AI Operations Engineer