AI ML Engineer

Overview

Develop and commercialize the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs, enabling efficient on-device inference for Generative AI models including LLMs and LVMs.

What you'll do

• Spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs.
• Push the limits of performance from large models as an AI inferencing expert.
• Deploy large C/C++ software stacks using best practices.
• Understand LLMs, Transformers and the nuances of edge-based GenAI deployment.

What you'll need

• Master’s/Bachelor’s degree in computer science or equivalent.
• 3+ years of relevant work experience in software development.
• Strong understanding of Generative AI models – LLM, LVM and LLMs and building blocks.
• Understanding of floating-point and fixed-point representations and quantization concepts.
• Experience optimizing algorithms for AI hardware accelerators like CPU/GPU/NPU.
• Strong development skills in C/C++.
• Excellent analytical and debugging skills.
• Good communication skills, including verbal, presentation and written communication.
• Ability to collaborate across a globally diverse team and multiple interests.

Nice to have

• Strong understanding of SIMD processor architecture and system design.
• Proficiency in object-oriented software development.
• Familiarity with Linux and Windows environments.
• Strong background in kernel development for SIMD architectures.
• Familiarity with frameworks like llama.cpp, MLX and MLC is a plus.
• Good knowledge of PyTorch, TFLite and ONNX Runtime is preferred.
• Experience with parallel computing systems and Assembly is a plus.

Details

• Location: Hyderabad, Telangana, India.