ZM-Net: Real-time Zero-shot Image Manipulation Network
Hao Wang, Xiaodan Liang, Hao Zhang, Dit-Yan Yeung, Eric P. Xing

TL;DR
ZM-Net introduces a fully-differentiable architecture capable of real-time, zero-shot image manipulation based on diverse guiding signals, including unseen ones, outperforming existing methods in efficiency and flexibility.
Contribution
The paper presents ZM-Net, the first model to enable real-time zero-shot image manipulation by jointly training a parameter generator and an image transformation network.
Findings
ZM-Net achieves high-quality manipulation in real-time.
It generalizes well to unseen guiding signals.
Constructed a large-scale style dataset with over 20,000 images.
Abstract
Many problems in image processing and computer vision (e.g. colorization, style transfer) can be posed as 'manipulating' an input image into a corresponding output image given a user-specified guiding signal. A holy-grail solution towards generic image manipulation should be able to efficiently alter an input image with any personalized signals (even signals unseen during training), such as diverse paintings and arbitrary descriptive attributes. However, existing methods are either inefficient to simultaneously process multiple signals (let alone generalize to unseen signals), or unable to handle signals from other modalities. In this paper, we make the first attempt to address the zero-shot image manipulation task. We cast this problem as manipulating an input image according to a parametric model whose key parameters can be conditionally generated from any guiding signal (even unseen…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Advanced Vision and Imaging · Advanced Image Processing Techniques
