BigVSAN: Enhancing GAN-based Neural Vocoders with Slicing Adversarial Network
Takashi Shibuya, Yuhta Takida, Yuki Mitsufuji

TL;DR
This paper introduces BigVSAN, a method that enhances GAN-based neural vocoders by integrating Slicing Adversarial Network (SAN) techniques, leading to improved audio synthesis quality with minimal modifications.
Contribution
It demonstrates the effectiveness of SAN in improving GAN-based vocoders, including BigVGAN, through a novel loss function modification compatible with SAN.
Findings
SAN improves vocoder performance
Minimal modifications enable SAN integration
Enhanced audio quality in GAN vocoders
Abstract
Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal projection for discriminating between real and fake data in the feature space. In the literature, it has been demonstrated that slicing adversarial network (SAN), an improved GAN training framework that can find the optimal projection, is effective in the image generation task. In this paper, we investigate the effectiveness of SAN in the vocoding task. For this purpose, we propose a scheme to modify least-squares GAN, which most GAN-based vocoders adopt, so that their loss functions satisfy the requirements of SAN. Through our experiments, we demonstrate that SAN can improve the performance of GAN-based vocoders, including BigVGAN, with small…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMusic and Audio Processing · Speech and Audio Processing · Speech Recognition and Synthesis
MethodsDogecoin Customer Service Number +1-833-534-1729
