Backend Engineer, AI (Agent Systems)

Overview

Build and operate the inference and orchestration layer behind AI interactions, turning model capabilities into reliable, observable APIs for mobile and desktop clients.

What you'll do

• Build backend systems for AI-powered production features.
• Design inference pipelines and model orchestration layers.
• Define service boundaries around models.
• Monitor, log, alert on, and respond to production incidents.
• Optimize latency and throughput through inference, caching, batching, and streaming.
• Improve performance and reliability based on real usage.

What you'll need

• Strong backend engineering fundamentals in production environments.
• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns, including LLMs, embeddings, and multimodal systems.
• Ability to debug distributed systems under load.
• Experience with Python, NodeJs, PyTorch, SQL, and NoSQL.
• Experience with Kubernetes and Docker.

Details

• Location: Germany.
• Interviews conducted via virtual meetings and/or onsite.