Platform Engineer III

Overview

Platform Engineer III to implement, maintain, and optimize AI platform capabilities on Google Kubernetes Engine (GKE) within Google Cloud Platform (GCP) for generative AI applications and self-hosted models.

What you'll do

• Implement, maintain, and optimize AI Platform capabilities deployed on GKE in GCP.
• Use software and platform engineering best practices (code quality, automated testing, CI/CD, GitOps, OTel telemetry, documentation).
• Collaborate with application, data science, and platform teams to collect feedback and troubleshoot integration issues.
• Build and integrate platform components, custom Kubernetes resources, and telemetry pipelines.
• Contribute to technical documentation and create reusable platform templates (“paved paths”).
• Execute technical roadmaps to improve reliability, reduce operational overhead, and speed delivery cycles.

What you'll need

• 5+ years experience.
• Hands-on deployment, configuration, and scaling of self-hosted LLMs on GKE using inference engines such as vLLM, NVIDIA NIM, or SGLang.
• Basic understanding of Kubernetes GPU allocation, multi-GPU nodes, and model execution requirements.
• Practical experience configuring OpenTelemetry (OTel) instrumentation and collectors for AI applications.
• Solid experience deploying and managing workloads on GKE and related GCP infrastructure (including GCE).
• Practical experience operating and troubleshooting Istio Ambient Mode (or sidecar-based Istio transitioning to Ambient) for mTLS and traffic routing.
• Strong proficiency in Python or Go for automation, custom tooling, scripts, or operators.

Details

• Location: Bangalore - Bagmane Tridib.