(Senior) Software Engineer - AI/ML (m/f/d)

Overview

Senior Software Engineer (AI/ML) to design, build, and operate backend services and APIs enabling AI-powered functionality at enterprise scale.

What you'll do

• Design, build, and operate backend services and APIs for AI-driven and traditional product capabilities.
• Develop production software using Java, and secondarily Python, focused on reliability, maintainability, and performance.
• Own services end-to-end from architecture and implementation through deployment, monitoring, and ongoing operations.
• Integrate LLMs, AI agents, and retrieval-based solutions into production applications.
• Build evaluation, monitoring, and observability capabilities for AI-powered features.
• Contribute to CI/CD pipelines and deployment automation.
• Troubleshoot complex production issues and drive continuous improvements in reliability and performance.

What you'll need

• Strong experience building backend applications with Java.
• Experience designing, building, and operating APIs, services, and distributed systems in production environments.
• Proficient Python skills for automation, integrations, and AI-related development.
• Hands-on cloud experience with Azure, AWS, or GCP plus CI/CD practices and Docker/containerized applications.
• Understanding of monitoring, logging, and observability for reliable and maintainable systems.
• Practical professional experience building, integrating, deploying, or operating AI-powered applications (including LLM-based solutions and retrieval systems).

Nice to have

• Preferred experience with LangChain, LangGraph, CrewAI, or similar AI application frameworks.
• Familiarity with vector databases including Pinecone, Weaviate, Milvus, Chroma, or pgvector.
• Experience with RAG architectures and AI evaluation frameworks such as Ragas or Promptfoo.
• Hands-on experience with Kubernetes, ideally AKS.
• Experience with Infrastructure as Code using Terraform or similar tools.
• Experience building multi-tenant SaaS platforms or enterprise software products.

Details

• Location: Bangalore (Whitefield, ITPL).
• Hybrid work model with minimum 50% office attendance; first six months require daily work from the Bangalore office (ITPL).