Senior Software Engineer — Infra Agent Systems Remote India

Overview

Senior Software Engineer for Together AI’s Infra Agent Systems, building production AI agent systems and the platform that powers them for operating a GPU fleet.

What you'll do

• Design and build production AI agent systems to diagnose, investigate, and remediate infrastructure issues.
• Build distributed services, orchestration framework, knowledge graph, and retrieval systems for infrastructure agents.
• Develop fleet intelligence systems using telemetry, infrastructure state, operational knowledge, and incident history.
• Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal systems via APIs.
• Own services end to end, covering architecture, implementation, testing, deployment, observability, and production operations.
• Improve agent performance using evaluations, retrieval improvements, better tools, and production feedback loops.

What you'll need

• 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms.
• Strong systems design skills and experience owning significant systems from design through production.
• Depth in at least one of AI agent systems, orchestration, tool use, evaluation, or grounding.
• Experience with at least one: knowledge graphs/graph data modeling or search/retrieval/ranking/RAG/semantic search systems.
• Strong backend engineering experience including API design, service boundaries, data modeling, and complex integrations.
• Experience with Kubernetes, GitOps such as ArgoCD, infrastructure-as-code, and cloud platforms.
• Comfort working across Go, TypeScript, Python, or Rust.

Details

• Remote, based in India.