Backend Software Engineer - AI/ML (m/f/d)

Overview

Design, build, and operate backend services and APIs that power AI-driven and traditional product capabilities on the ATOSS platform, as part of the Cognitive Backend team in Bangalore.

What you'll do

• Design, build, and operate backend services and APIs that power AI-driven and traditional product capabilities within the ATOSS platform.
• Develop high-quality production software using Java, and secondarily Python, with a strong focus on reliability, maintainability, and performance.
• Own services end-to-end, from architecture and implementation through deployment, monitoring, and ongoing operations.
• Integrate LLMs, AI agents, and retrieval-based solutions into production applications.
• Build and improve evaluation, monitoring, and observability capabilities for AI-powered features.
• Contribute to CI/CD pipelines, deployment automation, and engineering best practices.
• Help ensure AI-powered systems are scalable, secure, and production-ready.
• Troubleshoot complex production issues and drive continuous improvements in system reliability and performance.
• Work closely with AI Engineers, Product Owners, and Cloud Operations teams to bring new capabilities into production.

What you'll need

• Strong experience building backend applications with Java.
• Strong experience designing, building, and operating APIs, services, and distributed systems in production environments.
• Proficient Python skills for automation, integrations, and AI-related development.
• Hands-on experience with cloud platforms such as Azure, AWS, or GCP.
• Experience with modern CI/CD practices and containerized applications using Docker.
• Strong understanding of monitoring, logging, and observability, with a focus on building reliable and maintainable systems.
• Practical experience building, integrating, deploying, or operating AI-powered applications, LLM-based solutions, retrieval systems, agentic frameworks, or similar technologies in a professional environment.

Nice to have

• Experience with frameworks such as LangChain, LangGraph, CrewAI, or similar technologies for building AI-powered applications.
• Familiarity with vector databases such as Pinecone, Weaviate, Milvus, Chroma, or pgvector.
• Experience working with Retrieval-Augmented Generation (RAG) architectures and AI evaluation frameworks such as Ragas, Promptfoo, or similar tools.
• Hands-on experience with Kubernetes, ideally within Azure Kubernetes Service (AKS) environments.
• Experience with Infrastructure as Code using Terraform or similar technologies.
• Experience building multi-tenant SaaS platforms or enterprise software products.

Details

• Location: Bangalore (Whitefield, ITPL).
• Hybrid work model with a minimum of 50% office attendance.
• During the first six months, new team members work from the Bangalore Whitefield (ITPL) office on a daily basis; after onboarding, the role moves to the standard hybrid model.