AI/ML Site Reliability Engineer

Overview

As an AI/ML Site Reliability Engineer, you will build, operate, and enhance the Internal MCP Gateway and related production AI platform services.

What you'll do

• Build and harden the Internal MCP Gateway and related platform services.
• Implement observability, monitoring, and audit capabilities for agent tool-calling and MCP traffic.
• Maintain availability, performance, and reliability targets for MCP components.
• Support secure hosting and runtime environments for MCP servers and related services.
• Partner with ML and Quality Engineers on testing, evaluation, and safe platform rollouts.
• Contribute to service management, incident response, and production readiness.
• Help shape platform architecture for federated MCP scale.

What you'll need

• Strong Python experience for platform services and operational tooling.
• Experience with observability and monitoring stacks, including metrics, tracing, logging, and dashboards.
• SQL skills for operational analysis, reporting, and audit queries.
• Hands-on experience operating services on AWS.
• Knowledge of cloud-native reliability patterns and service lifecycle management.
• Experience supporting platforms subject to audit, compliance, and regulated delivery processes.

Details

• Location: Hyderabad, Telangana, India.
• Career stage: Senior Associate.