SDE IV - GPU Engineer

Overview

Role: SDE IV - GPU Engineer at Glance, working as a GPU Systems Engineer to lead design and optimization across the GPU inference stack.

What you'll do

• Architect high-performance inference runtimes, kernel dispatchers, and memory planners for diffusion and transformer workloads.
• Lead investigations into cross-GPU performance bottlenecks, communication overheads, and scheduling inefficiencies.
• Drive multi-GPU parallelism strategies including model, pipeline, and tensor parallelization.
• Establish company-wide GPU optimization standards, tooling, and SLIs.
• Collaborate with research to design scalable implementations of novel architectures.
• Partner with hardware vendors and infra teams to maximize cluster utilization.

What you'll need

• 5+ years in high-performance computing, GPU runtime systems, or ML infrastructure.
• Proven expertise in CUDA / Triton / C++.
• Experience building and maintaining distributed inference or training systems.
• Strong knowledge of NCCL, NVLink, PCIe, and interconnects.
• Familiarity with profiling automation and performance dashboards.
• Excellent technical leadership and mentoring capabilities.

Nice to have

• Background in compiler-aided optimization (TVM, XLA, MLIR, Triton).
• Experience tuning Stable Diffusion or transformer inference pipelines.
• Exposure to heterogeneous compute backends (AMD ROCm, TPU, ASICs).
• Experience with hardware–software co-design initiatives.
• Open-source or research contributions in GPU optimization.

Details

• Location: Bangalore.