Adversarial Multi-Task Deep Learning for Noise-Robust Voice Activity Detection with Low Algorithmic Delay

Claus Meyer Larsen, Peter Koch, Zheng-Hua Tan*


Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review


Voice Activity Detection (VAD) is an important pre-processing step in a wide variety of speech processing systems. VAD should in a practical application be able to detect speech in both noisy and noise-free environments, while not introducing significant latency. In this work we propose using an adversarial multi-task learning method when training a supervised VAD. The method has been applied to the state-of-the-art VAD Waveform-based Voice Activity Detection. Additionally the performance of the VAD is investigated under different algorithmic delays, which is an important factor in latency. Introducing adversarial multi-task learning to the model is observed to increase performance in terms of Area Under Curve (AUC), particularly in noisy environments, while the performance is not degraded at higher SNR levels. The adversarial multi-task learning is only applied in the training phase and thus introduces no additional
cost in testing. Furthermore the correlation between performance and algorithmic delays is investigated, and it is observed that the VAD performance degradation is only moderate when lowering the algorithmic delay from 398 ms to 23 ms. Index Terms: Voice Activity Detection, adversarial multi-task learning, algorithmic delay, deep learning, noise robustness.
TitelInterspeech 2022
StatusUdgivet - 2022
BegivenhedInterspeech 2022 - Incheon, Sydkorea
Varighed: 18 sep. 202222 sep. 2022


KonferenceInterspeech 2022
NavnProceedings of the International Conference on Spoken Language Processing


Dyk ned i forskningsemnerne om 'Adversarial Multi-Task Deep Learning for Noise-Robust Voice Activity Detection with Low Algorithmic Delay'. Sammen danner de et unikt fingeraftryk.