Overview
Software Engineer for SingleStore Cloud’s AI Platform team, building core backend capabilities for AI/ML and AI Agents.
What you'll do
- Build and evolve backend services for agent orchestration, tool execution, retrieval/RAG pipelines, and model serving integrations.
- Design APIs and control plane workflows for AI platform components with tenant-aware, secure-by-default, observable behavior.
- Implement MCP-style tool discovery/integration patterns so agents can safely call tools and internal services.
- Enable reliability and scale with mechanisms like latency/cost controls, rate limiting, fallbacks, rollouts, and incident response readiness.
- Establish evaluation best practices including offline test sets, regression detection, and prompt/model/version tracking with quality gates.
- Contribute to secure-by-design AI approaches including permissions, data access boundaries, prompt injection defenses, and auditability.
- Mentor junior engineers and contribute to a high-ownership team environment.
What you'll need
- 4+ years of experience working on a SaaS product or production platform.
- Strong software engineering skills with experience in distributed systems using Go, Python, or similar.
- Experience building cloud-native services including Kubernetes, containers, service-to-service APIs, and CI/CD.
- Strong understanding of AI/ML fundamentals (supervised learning basics, LLM basics, and embeddings/vector search fundamentals).
- Strong debugging and problem-solving skills, including incident-style troubleshooting across services and infrastructure.
- Intellectual curiosity and passion for robust, maintainable systems in a fast-paced team environment.
Nice to have
- Hands-on experience with AI agents and orchestration frameworks (tool calling, workflows, planners/executors).
- Practical experience with RAG systems, reranking, grounding, and evaluation strategies.
- Experience with model serving patterns (batch/online inference, caching, streaming responses).
- Knowledge of security considerations for AI systems (data isolation, RBAC, prompt injection threats, audit logs).
- Familiarity with observability stacks and SLO-driven engineering.
- Familiarity with vector databases/capabilities in modern data platforms.
Details
- Work involves AI platform engineering across agent runtimes, tool integration, and an operational layer to run systems reliably at scale.
