# Analysis by Adversarial Synthesis -- A Novel Approach for Speech   Vocoding

**Authors:** Ahmed Mustafa, Arijit Biswas, Christian Bergler, Julia Schottenhamml, and Andreas Maier

arXiv: 1907.00772 · 2019-07-02

## TL;DR

This paper introduces a GAN-based neural speech vocoder that produces high-quality speech reconstruction from compressed representations, overcoming the slow generation of autoregressive models and improving perceptual quality.

## Contribution

It proposes a novel GAN-based method for neural speech vocoding that refines compressed signals for natural reconstruction, enabling one-shot generation and better perceptual quality.

## Key findings

- Higher perceptual quality than classical vocoders according to evaluations.
- Enables one-shot signal generation, faster than autoregressive models.
- Effective on a dataset of 30 speakers.

## Abstract

Classical parametric speech coding techniques provide a compact representation for speech signals. This affords a very low transmission rate but with a reduced perceptual quality of the reconstructed signals. Recently, autoregressive deep generative models such as WaveNet and SampleRNN have been used as speech vocoders to scale up the perceptual quality of the reconstructed signals without increasing the coding rate. However, such models suffer from a very slow signal generation mechanism due to their sample-by-sample modelling approach. In this work, we introduce a new methodology for neural speech vocoding based on generative adversarial networks (GANs). A fake speech signal is generated from a very compressed representation of the glottal excitation using conditional GANs as a deep generative model. This fake speech is then refined using the LPC parameters of the original speech signal to obtain a natural reconstruction. The reconstructed speech waveforms based on this approach show a higher perceptual quality than the classical vocoder counterparts according to subjective and objective evaluation scores for a dataset of 30 male and female speakers. Moreover, the usage of GANs enables to generate signals in one-shot compared to autoregressive generative models. This makes GANs promising for exploration to implement high-quality neural vocoders.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/1907.00772/full.md

## Figures

9 figures with captions in the complete paper: https://tomesphere.com/paper/1907.00772/full.md

## References

25 references — full list in the complete paper: https://tomesphere.com/paper/1907.00772/full.md

---
Source: https://tomesphere.com/paper/1907.00772