Staff Product Software Engineer

Overview

Lead the architecture and production reliability of AI runtime systems within Ad Platforms. Partner with engineering, infrastructure, security, architecture, and product teams to operate AI-powered services reliably at scale.

What you'll do

• Define reliability architecture standards and latency SLOs for AI workloads.
• Design circuit breakers, retries, fallbacks, and graceful degradation strategies.
• Lead multi-provider failover strategies across Azure, OpenAI, Bedrock, and future providers.
• Model concurrency and validate throughput for model-dependent services.
• Drive resilience testing, load validation, and production readiness reviews.
• Lead incident analysis and architectural reliability improvements.
• Mentor engineers on distributed systems and resilience patterns.

What you'll need

• 8+ years of backend software engineering experience building distributed systems at scale.
• Strong proficiency in Python or a similar backend language.
• Deep experience designing resilient microservices architectures.
• Experience defining and enforcing service-level objectives.
• Experience with AWS, Azure, or GCP cloud environments.
• Experience operating AI-powered or model-dependent services in production.
• Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent experience.

Nice to have

• Experience designing multi-provider failover strategies.
• Experience with high-throughput, low-latency service architectures.
• Experience leading incident response for distributed systems.
• Master’s degree in a related technical field.

Details

• Location: Bangalore, India.
• Employment type: Full time.