AI Phone - On-device AI / ML Systems Engineer

Overview

Build and optimize on-device AI and ML models for mobile phones, including model evaluation, benchmarking, integration and hybrid local/cloud routing.

What you'll do

• Evaluate suitable open-weight and commercially available models for on-device execution.
• Benchmark model performance on target mobile hardware.
• Integrate models into Android applications and system services.
• Optimize inference latency, memory consumption and power usage.
• Evaluate quantization, compression and model distillation techniques.
• Work with CPU, GPU and NPU acceleration.
• Evaluate local model capabilities for different workflows.
• Build hybrid local/cloud model routing mechanisms.
• Identify which tasks can be handled locally and which require cloud inference.
• Work with AI agent engineers to integrate local models into the agent runtime.

What you'll need

• Strong ML systems or inference engineering experience.
• Experience deploying and optimizing models.
• Strong Python and C++ skills.
• Understanding of neural network inference.
• Experience with model quantization and performance optimization.
• Understanding of hardware constraints and inference benchmarks.

Nice to have

• Experience with on-device LLMs.
• Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.
• ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.
• Android NDK.
• Mobile or edge AI deployment.
• Multimodal model optimization.