Overview
Design and develop scalable backend services and REST APIs using Python, and build production-grade Generative AI/LLM applications and services.
What you'll do
- Design and develop scalable backend services and REST APIs using Python, FastAPI, Flask, and Django.
- Build and integrate Generative AI/LLM-based applications, including RAG, AI agents, embeddings, and tool/function calling.
- Work with Azure OpenAI and other LLM providers.
- Use AI frameworks such as LangChain, LlamaIndex, LangGraph, or similar.
- Implement LiteLLM for LLM gateway, routing, fallback, and usage/cost management.
- Implement rate limiting, throttling, caching, retries, and API quotas for scalable services.
- Use Langfuse for LLM observability, tracing, prompt management, token/cost tracking, and evaluation.
- Design and work with PostgreSQL/MySQL, MongoDB, and Redis.
- Deploy and manage applications using Microsoft Azure, Docker, and CI/CD.
- Develop unit/integration tests, troubleshoot production issues, and optimize performance and cost.
- Participate in system design, code reviews, and technical architecture discussions.
What you'll need
- 5–7 years of software development experience with strong Python and backend development skills.
- Hands-on experience in Generative AI/LLM applications.
- Strong understanding of REST APIs, microservices, RAG, embeddings, vector databases, prompt engineering, AI agents, rate limiting, and distributed systems.
- Experience with Microsoft Azure, Docker, CI/CD, databases, Redis, API security, and cloud-native application development.
- Strong problem-solving, communication, and ownership.
- Ability to build production-grade AI solutions.
Nice to have
- Hands-on experience with Azure OpenAI, LiteLLM, and Langfuse.
- Exposure to LangChain, LlamaIndex, LangGraph, or similar AI frameworks.
Details
- Location: Ahmedabad, India — Ognaj (eInfochips).
- Employment type: Full time.
- Job category: Engineering Services.
Read the full description and apply on the company’s own careers page.