INDStaff Software Engineer - AI

Overview

Senior (T7) AI Engineer role in Hyderabad, India, combining hands-on AI/ML engineering with software development to build, deploy and operate production-grade AI systems at enterprise scale.

What you'll do

• Design, build and deploy production AI systems including RAG pipelines, agentic workflows, multi-model orchestration and intelligent automation.
• Integrate LLM APIs and AI/ML services into enterprise applications (GCP Vertex AI).
• Implement and optimize prompt engineering strategies, fine-tuning pipelines, embeddings and vector search solutions.
• Build and maintain AI orchestration workflows using frameworks such as LangChain, Semantic Kernel, AutoGen, CrewAI or LlamaIndex.
• Develop custom AI agents, tools and autonomous workflows that solve real business problems.
• Establish evaluation frameworks for AI systems measuring accuracy, latency, cost, hallucination rates and business outcomes.
• Build end-to-end AI-powered applications spanning frontend, backend, APIs and data layers.
• Develop robust backend services using Python (FastAPI/Django) or Node.js to support AI workloads.
• Implement and optimize RESTful APIs, GraphQL endpoints and event-driven integrations for AI services.
• Build modern frontend interfaces for AI-powered features using React, Angular or Vue.js with TypeScript.
• Write clean, well-tested, production-ready code with a focus on maintainability and operational excellence.
• Design and implement MLOps/LLMOps pipelines for reliable model deployment, versioning and lifecycle management.
• Configure and manage cloud-native AI infrastructure (AWS, GCP) including model serving, orchestration and auto-scaling.
• Implement observability for AI systems, monitoring model drift, token costs, latency, throughput and quality metrics.
• Build and maintain CI/CD pipelines for AI model deployment, automated testing and continuous evaluation.
• Design for resilience with failover strategies, fallback models, circuit breakers and graceful degradation.
• Use AI coding assistants (GitHub Copilot, Cursor, Claude, etc.) for code generation, refactoring, test writing, documentation and code review.
• Develop and maintain custom AI-powered developer tools, automations and internal platforms.
• Establish guardrails, security practices and governance for responsible AI usage in engineering.
• Evangelize AI-first development practices, train and upskill team members, and contribute to internal knowledge bases, tech talks and communities of practice.
• Partner with product, design and data science teams to identify and deliver AI-driven opportunities.
• Participate in architecture reviews and design discussions, ensuring AI solutions are production-ready from day one.

What you'll need

• 8+ years of professional software engineering experience, with 2+ years focused on AI/ML solution development and delivery.
• Bachelor's degree in Computer Science, Software Engineering, AI/ML or related field (or equivalent experience).
• Strong understanding of large language model architectures, capabilities and limitations.
• Proven track record building and deploying production AI systems (RAG, agents, fine-tuning, embeddings, vector search).
• Proficiency with AI orchestration frameworks (LangChain, Semantic Kernel, AutoGen, CrewAI, LlamaIndex).
• Hands-on experience with major LLM providers and platforms (OpenAI, Anthropic, Google Vertex AI, AWS Bedrock).
• Solid understanding of prompt engineering, evaluation methodologies and AI safety/guardrails.
• Expert-level proficiency in Python; strong skills in at least one additional language (Java, TypeScript/Node.js, C#/.NET).
• Hands-on experience deploying and operating AI workloads on cloud platforms (AWS, GCP or Azure), containerization (Docker, Kubernetes) and CI/CD tooling (Jenkins, GitHub Actions).
• Proficiency with SQL and NoSQL databases, vector databases (Pinecone, Weaviate, pgvector, ChromaDB) and data pipeline tools.
• Proven track record building production APIs (REST, GraphQL, gRPC) and event-driven integrations.
• Advanced daily usage of AI coding assistants with demonstrated impact on productivity and code quality.
• Strong testing practices for AI systems including model evaluation, integration testing and automated quality checks.
• Excellent written and verbal communication skills with ability to explain complex AI concepts to diverse audiences.

Nice to have

• Experience building enterprise AI platforms serving multiple product teams.
• Familiarity with custom model training, fine-tuning (LoRA, QLoRA) and RLHF techniques.
• Experience with agent-based AI architectures and autonomous multi-step workflows.
• Knowledge of AI security concerns (prompt injection, data leakage, model poisoning) and mitigation strategies.
• Experience in regulated industries (insurance, finance, healthcare) with security and compliance requirements.
• Contributions to open-source AI/ML projects or published technical content.
• Cloud certifications (AWS Solutions Architect, GCP Professional Cloud Architect, or equivalent).
• Experience with real-time inference, streaming responses and low-latency AI serving architectures.

Details

• Location: Hyderabad, India.
• Employment type: Full-Time.
• Level: T7 (Senior Engineer).