Overview
Staff Software Engineer in Walmart's Data Ventures team, building the core platform capabilities that power B2B data and AI products for merchants and suppliers.
What you'll do
- Design and own core platform capabilities, including plugin and extension systems, agent orchestration engines, and semantic and data abstraction layers.
- Architect and implement multi-step, parallel, and cross-domain agentic workflows powered by large language models, ensuring correctness, reliability, and safe execution.
- Build and enforce governed tool execution and security boundaries, including access controls, tenant isolation, and scope enforcement.
- Define and evolve the platform's data and semantic layer, bridging relational, vector, semantic-modelled, and API sources into a unified representation.
- Establish and uphold non-functional requirements, including latency SLAs, throughput targets, data isolation guarantees, and availability contracts.
- Own observability and explainability as platform primitives, including audit pipelines, structured logging, response attribution, and governance metadata.
- Define architectural dependency rules and enforce them through code, tests, and design reviews.
- Partner across engineering, product, and data science teams to translate platform capabilities into reliable, well-documented contracts.
- Mentor engineers, lead design reviews, and build a culture of platform thinking.
What you'll need
- 10+ years of software engineering experience, with meaningful depth in platform, infrastructure, or foundational systems.
- Hands-on experience designing and shipping production LLM-based systems, such as agent orchestration, tool use, RAG pipelines, multi-step reasoning, or structured output generation.
- Strong software engineering fundamentals, including clean API design, distributed systems patterns, async execution, fault tolerance, and observability.
- Experience designing extensible plugin or extension systems with stable, versioned contracts and well-defined conformance expectations.
- Proficiency in Python and familiarity with the AI/ML ecosystem; comfort reasoning about latency, throughput, and cost tradeoffs in inference-heavy workloads.
- Deep appreciation for architectural principles, including separation of concerns, dependency inversion, layered design, and enforcement of contracts through code.
- Experience owning and operating multi-tenant systems with strict data isolation and access control requirements.
Nice to have
- Experience with LLM governance, AI safety frameworks, guardrails, or responsible AI patterns in production.
- Background in semantic modelling, data mesh, or building canonical data layers consumed by downstream AI or analytics systems.
- Prior work in a platform engineering role serving multiple product teams as internal customers.
- Familiarity with agentic frameworks (LangGraph, LangFuse, GoogleADK, CrewAI, or equivalent) and the tradeoffs of building on top of vs. owning the orchestration layer.
- Experience defining and enforcing engineering standards across a team or organization.
Details
- Based in the Bangalore office for daily work, with flexibility for associates to manage personal lives.
- Primary location: Building 10 (SEZ), Cessna Business Park, Kadubeesanahalli Village, Varthur Hobli, India.
Read the full description and apply on the company’s own careers page.