Sr Product Software Engineer I

Overview

Sr Product Software Engineer I will serve as technical leader for AI Runtime & Reliability within Foundations Engineering (AI Production Engineering), ensuring shared AI capabilities operate reliably and predictably at scale in production.

What you'll do

• Define reliability architecture standards for AI workloads across Ad Platforms.
• Set latency SLOs and reliability targets for AI-dependent services.
• Design resilience patterns including circuit breakers, retries, fallbacks, and graceful degradation.
• Lead multi-provider failover strategies across Azure, OpenAI, Bedrock, and future providers.
• Build scalable backend services for high-volume AI traffic and validate throughput via concurrency modeling.
• Drive resilience testing and failure readiness before beta/production releases.
• Lead post-incident analysis and drive architectural improvements to address reliability risks.

What you'll need

• 5+ years of backend software engineering experience building distributed systems at scale.
• Strong proficiency in Python (or similar backend language).
• Deep experience designing resilient microservices architectures.
• Strong understanding of retry semantics, circuit breakers, caching, and graceful degradation.
• Experience defining and enforcing service-level objectives (SLOs).
• Experience with cloud environments such as AWS, Azure, or GCP.
• Experience operating AI-powered or model-dependent services in production.
• Familiarity with LLM provider constraints including rate limits, latency variability, and concurrency caps.

Details

• Location: Bangalore, India.
• Employment type: Full time.