A New Frontier of AI: On-Device AI Training and Personalization
Ji Joong Moon, Hyun Suk Lee, Jiho Chu, Donghak Park, Seungbaek Hong,, Hyungjun Seo, Donghyeon Jeong, Sungsik Kong, MyungJoo Ham

TL;DR
This paper introduces NNTrainer, a lightweight, memory-efficient on-device training framework that enables personalization of AI services directly on consumer devices without compromising accuracy.
Contribution
It presents NNTrainer, a novel framework with optimized memory management and execution strategies, facilitating effective on-device neural network training on resource-constrained devices.
Findings
Reduces memory usage to 1/20 of traditional methods
Enables effective personalization of AI services on devices
Open-source deployment on millions of mobile devices
Abstract
Modern consumer electronic devices have started executing deep learning-based intelligence services on devices, not cloud servers, to keep personal data on devices and to reduce network and cloud costs. We find such a trend as the opportunity to personalize intelligence services by updating neural networks with user data without exposing the data out of devices: on-device training. However, the limited resources of devices incurs significant difficulties. We propose a light-weight on-device training framework, NNTrainer, which provides highly memory-efficient neural network training techniques and proactive swapping based on fine-grained execution order analysis for neural networks. Moreover, its optimizations do not sacrifice accuracy and are transparent to training algorithms; thus, prior algorithmic studies may be implemented on top of NNTrainer. The evaluations show that NNTrainer…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsIoT and Edge/Fog Computing · Age of Information Optimization · Advanced Neural Network Applications
