Senior Technical Product Manager - AI Agents, Evals & Reliability

Overview

Own the strategy, system design, evaluation, and delivery of reliable AI-agent products. Partner closely with engineering and ML teams to turn model capabilities into predictable, trusted user experiences.

What you'll do

• Define end-to-end AI system requirements from capability through user impact.
• Translate model capabilities, data constraints, and evaluation results into product decisions.
• Balance quality, latency, cost, reliability, and user experience trade-offs.
• Collaborate with ML, backend, and mobile engineers on system design and iteration.
• Develop evaluation frameworks using offline metrics, online experiments, and human feedback.
• Drive execution through clear specifications, prioritization, and feedback loops.
• Own product quality, including correctness, predictability, and user trust.

What you'll need

• Strong computer science fundamentals in algorithms, data structures, and system design.
• Solid understanding of machine learning fundamentals and production AI systems.
• Experience with AI-powered products, including LLM-based systems.
• Experience with model evaluation, prompt or pipeline iteration, and feedback loops.
• Significant experience owning complex technical products end-to-end.
• Ability to work closely with senior engineers and ML teams.
• Strong judgment in ambiguous, fast-moving environments.

Nice to have

• Experience shipping AI-heavy consumer products.
• Engineering or highly technical product management background.
• Experience defining evaluation metrics for ML systems.
• Strong intuition for AI UX patterns and failure handling.
• Experience in zero-to-one product environments.

Details

• Location: Indonesia.
• Interviews may be conducted virtually or onsite.