Positive-Unlabeled Compression on the Cloud
Yixing Xu, Yunhe Wang, Hanting Chen, Kai Han, Chunjing Xu, Dacheng, Tao, Chang Xu

TL;DR
This paper introduces a positive-unlabeled learning approach combined with knowledge distillation to efficiently compress and accelerate CNN models on the cloud using minimal labeled data and abundant unlabeled data.
Contribution
It proposes a novel PU-based training framework with attention-based feature extraction and robust knowledge distillation for cloud-based model compression.
Findings
Achieves comparable performance with only 8% of ImageNet data
Effectively handles class imbalance in augmented training data
Demonstrates superior results on benchmark models and datasets
Abstract
Many attempts have been done to extend the great success of convolutional neural networks (CNNs) achieved on high-end GPU servers to portable devices such as smart phones. Providing compression and acceleration service of deep learning models on the cloud is therefore of significance and is attractive for end users. However, existing network compression and acceleration approaches usually fine-tuning the svelte model by requesting the entire original training data (\eg ImageNet), which could be more cumbersome than the network itself and cannot be easily uploaded to the cloud. In this paper, we present a novel positive-unlabeled (PU) setting for addressing this problem. In practice, only a small portion of the original training set is required as positive examples and more useful training examples can be obtained from the massive unlabeled data on the cloud through a PU classifier with…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Neural Network Applications · Machine Learning and Data Classification · Digital Imaging for Blood Diseases
MethodsKnowledge Distillation
