Overview
Distinguished Machine Learning Engineer on the Catalog Data Science team at Walmart Global Tech, setting technical direction and leading the design of large-scale AI/ML platforms and products for Walmart's product catalog.
What you'll do
- Define and drive the multi-year technical strategy and architecture for catalog AI/ML systems across classification, attribution, trust & safety and generative experiences.
- Architect production-grade GenAI systems including retrieval orchestration, tool/use-case routing, policy engines, and evaluation harnesses.
- Lead the design of training and serving stacks for LLMs and multi-modal models: distributed fine-tuning, parameter-efficient methods, distillation, quantization and compilation.
- Own and improve reliability, latency and cost SLOs for online inference; design autoscaling, caching, batching, and GPU/accelerator utilization strategies.
- Establish platform standards for data quality, lineage, governance and cost management across ML pipelines.
- Build reusable evaluation and observability frameworks (offline metrics, human-in-the-loop, A/B testing, canaries) with robust telemetry and alerting.
- Champion MLOps/LLMOps best practices: CI/CD for models, registries, feature/embedding stores, vector databases, rollout/rollback, shadowing and drift detection.
- Mentor and develop Senior/Staff engineers and scientists; raise the bar on code quality, design reviews, technical writing and operational excellence.
- Influence cross-functional roadmaps and align with Product, Platform, Data Engineering, Security and Infrastructure to deliver outcomes at global scale.
- Publish, file patents and build partnerships with academia/open-source communities; represent Walmart at top-tier AI/ML venues.
- Ensure solutions meet privacy, security, compliance and Responsible AI requirements.
- Architect and lead fine-tuning, distillation and domain adaptation of foundation models (LLMs and vision-language) for retail-specific tasks, including instruction-tuning and RAG.
- Optimize inference at scale using quantization, tensor/pipeline parallelism, speculative decoding, KV-cache management and high-performance serving (e.g., Triton, vLLM, TensorRT-LLM).
- Design rigorous evaluation and safety frameworks for generative systems (LLM-as-judge, red teaming, factuality, bias/fairness, toxicity) and enforce policy through guardrails.
- Adhere to Walmart's policies, procedures, mission, values, standards of ethics and integrity.
- Adopt to Walmart's quality standards, develop/recommend process standards and best practices across the retail industry.
What you'll need
- Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 6 years' experience in software engineering, machine learning engineering, AI systems or related area.
- Option 2: 8 years' experience in software engineering, machine learning engineering, AI systems or related area.
- Bachelors/Masters/PhD from a reputed institution.
- Minimum of 15 years of AI/ML experience.
- Demonstrated history of technology leadership and strong hands-on experience.
- Past experience in strong programming skills across big data and ML engineering stack.
- Strong communication skills with inclination to high ownership and commitment.
Nice to have
- Master's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years' experience in software engineering, machine learning engineering, AI systems or related area.
- Prior work experience in accessibility best practices.
- Prior work experience in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly.
Details
- Location: Bangalore, India (Block-1, Prestige Tech Pacific Park, Outer Ring Rd, Kadubeesanahalli).
- Based in the Bangalore office for daily work, with flexibility for associates to manage personal lives.
Read the full description and apply on the company’s own careers page.