Delving into Rectifiers in Style-Based Image Translation
Yipeng Zhang, Bingliang Hu, Hailong Ning, Quang Wang

TL;DR
This paper investigates how rectifier activation functions influence style control in image translation, proposing adaptive techniques to enhance controllability and diversity of generated images.
Contribution
It introduces AdaReLU and structural adaptive functions that improve style controllability in image translation by manipulating activation slopes and feature map structures.
Findings
Enhanced controllability of style-based image translation.
Increased diversity of generated images.
Effective manipulation of feature maps using proposed methods.
Abstract
While modern image translation techniques can create photorealistic synthetic images, they have limited style controllability, thus could suffer from translation errors. In this work, we show that the activation function is one of the crucial components in controlling the direction of image synthesis. Specifically, we explicitly demonstrated that the slope parameters of the rectifier could change the data distribution and be used independently to control the direction of translation. To improve the style controllability, two simple but effective techniques are proposed, including Adaptive ReLU (AdaReLU) and structural adaptive function. The AdaReLU can dynamically adjust the slope parameters according to the target style and can be utilized to increase the controllability by combining with Adaptive Instance Normalization (AdaIN). Meanwhile, the structural adaptative function enables…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Multimodal Machine Learning Applications · Cancer-related molecular mechanisms research
MethodsAdaptive Instance Normalization · Instance Normalization · Convolution
