NVIDIA has helped redefine what computers can do. Now, generative AI is opening new possibilities for how people learn, create, and tackle problems. Realizing that potential means answering some of the hardest questions in AI: Where do models fall short?
AI Phone - On-device AI / ML Systems Engineer
China, United States
November 4, 2026
Job description
About
We are reimagining the phone. AI phones need to be proactive, intuitive, intelligent and low cost. This is a mission critical for rest of the world to adopt intelligence.
There are over 5 billion people using everyday applications such as email, messaging, notes, tasks, and calendars, yet most are not AI-native. Our mission is to build proactive applications and devices that bring intelligence into daily conversations, coordination and workflows, with minimal prompting.
Responsibilities
- Evaluate suitable open-weight and commercially available models for on-device execution.
- Benchmark model performance on target mobile hardware.
- Integrate models into Android applications and system services.
- Optimize inference latency, memory consumption and power usage.
- Evaluate quantization, compression and model distillation techniques.
- Work with CPU, GPU and NPU acceleration.
- Evaluate local model capabilities for different workflows.
- Build hybrid local/cloud model routing mechanisms.
- Identify which tasks can be handled locally and which require cloud inference.
- Work with AI agent engineers to integrate local models into the agent runtime.
Requirements
- Strong ML systems or inference engineering experience.
- Experience deploying and optimizing models.
- Strong Python and C++ skills.
- Understanding of neural network inference.
- Experience with model quantization and performance optimization.
- Understanding of hardware constraints and inference benchmarks.
Nice to have
- Experience with on-device LLMs.
- Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.
- ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.
- Android NDK.
- Mobile or edge AI deployment.
- Multimodal model optimization.
Available regions
Each region below is open to applicants in that country only. Apply through the link for your region.
Available in 2 regions: pick your country, then finish on the employer's site.
At Solventum, we improve lives by helping healthcare professionals do their best work. Join a team using innovation and insight to make a real impact on the future of healthcare.
Ethos (Nasdaq: $LIFE) is a leading life insurance technology company on a mission to protect families by democratizing access to life insurance and empowering agents at scale.
At Sword, we’re building AI to heal billions and unlock humanity’s full potential. In doing so, we’re pioneering AI Care, a fundamentally new approach to healthcare built for medical reasoning, safety, and real-time treatment, not generic technology applied after the fact.