Langevin Cooling for Domain Translation
Vignesh Srinivasan, Klaus-Robert M\"uller, Wojciech Samek, Shinichi, Nakajima

TL;DR
This paper introduces Langevin Cooling (L-Cool), a method that improves domain translation by moving low-density, poorly modeled samples towards high-density regions, enhancing existing unsupervised translation models.
Contribution
The paper proposes Langevin Cooling (L-Cool), a novel technique that refines domain translation by leveraging Langevin dynamics to improve sample quality in low-density areas.
Findings
L-Cool improves image translation quality.
L-Cool enhances language translation performance.
The method effectively moves fringe samples to high-density regions.
Abstract
Domain translation is the task of finding correspondence between two domains. Several Deep Neural Network (DNN) models, e.g., CycleGAN and cross-lingual language models, have shown remarkable successes on this task under the unsupervised setting---the mappings between the domains are learned from two independent sets of training data in both domains (without paired samples). However, those methods typically do not perform well on a significant proportion of test samples. In this paper, we hypothesize that many of such unsuccessful samples lie at the fringe---relatively low-density areas---of data distribution, where the DNN was not trained very well, and propose to perform Langevin dynamics to bring such fringe samples towards high density areas. We demonstrate qualitatively and quantitatively that our strategy, called Langevin Cooling (L-Cool), enhances state-of-the-art methods in…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Domain Adaptation and Few-Shot Learning · Multimodal Machine Learning Applications
MethodsGAN Least Squares Loss · Tanh Activation · PatchGAN · Instance Normalization · HuMan(Expedia)||How do I get a human at Expedia? · Cycle Consistency Loss · Batch Normalization · *Communicated@Fast*How Do I Communicate to Expedia? · Residual Connection · Residual Block
