We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Artificial Intelligence & Machine Learning/Conditional Generative Adversarial Networks for Speech Enhancement and Noise-Robust Speaker Verification
Conference ProceedingsArtificial Intelligence & Machine Learning

Conditional Generative Adversarial Networks for Speech Enhancement and Noise-Robust Speaker Verification

Checking your access to this record.

Abstract & Overview

Improving speech system performance in noisy environments remains a challenging task, and speech enhancement (SE) is one of the effective techniques to solve the problem. Motivated by the promising results of generative adversarial networks (GANs) in a variety of image processing tasks, we explore the potential of conditional GANs (cGANs) for SE, and in particular, we make use of the image processing framework proposed by Isola et al. [1] to learn a mapping from the spectrogram of noisy speech to an enhanced counterpart. The SE cGAN consists of two networks, trained in an adversarial manner: a generator that tries to enhance the input noisy spectrogram, and a discriminator that tries to distinguish between enhanced spectrograms provided by the generator and clean ones from the database using the noisy spectrogram as a condition. We evaluate the performance of the cGAN method in terms of perceptual evaluation of speech quality (PESQ), short-time objective intelligibility (STOI), and equal error rate (EER) of speaker verification (an example application). Experimental results show that the cGAN method overall outperforms the classical short-time spectral amplitude minimum mean square error (STSA-MMSE) SE algorithm, and is comparable to a deep neural network-based SE approach (DNN-SE).

Cite this record

Daniel Michelsanti, Zheng‐Hua Tan (2017). Conditional Generative Adversarial Networks for Speech Enhancement and Noise-Robust Speaker Verification. VBN Forskningsportal (Aalborg Universitet). https://doi.org/10.21437/interspeech.2017-1620

Copy in another style

Michelsanti, D., & Tan, Z. (2017). Conditional Generative Adversarial Networks for Speech Enhancement and Noise-Robust Speaker Verification. VBN Forskningsportal (Aalborg Universitet). https://doi.org/10.21437/interspeech.2017-1620
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.