Improved External Speaker-Robust Keyword Spotting for Hearing Assistive Devices

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

4 Citationer (Scopus)
4 Downloads (Pure)

Abstrakt

For certain applications, keyword spotting (KWS) requires some degree of personalization. This is the case for KWS for hearing assistive devices, e.g., hearing aids, where only the device user should be allowed to trigger the KWS system. In this paper, we first develop a new realistic hearing aid experimental framework. Next, using this framework we show that the performance of a state-of-the-art multi-task deep learning architecture exploiting cepstral features for joint KWS and users' own-voice/external speaker detection drops significantly. To overcome this problem, we use phase difference information through GCC-PHAT (Generalized Cross-Correlation with PHAse Transform)-based coefficients along with log-spectral magnitude features. In addition, we demonstrate that working in the perceptually-motivated constant-Q transform (CQT) domain instead of in the short-time Fourier transform (STFT) domain allows for the generation of compact and coherent features which provide superior KWS performance. Our experimental results show that our CQT-based proposal achieves a relative KWS accuracy improvement of around 18% compared to using cepstral features while dramatically decreasing the number of multiplications in the multi-task architecture, which is key in the context of low-resource devices like hearing assistive devices.

OriginalsprogEngelsk
Artikelnummer9054977
TidsskriftIEEE/ACM Transactions on Audio, Speech, and Language Processing
Vol/bind28
Sider (fra-til)1233-1247
Antal sider15
ISSN2329-9290
DOI
StatusUdgivet - apr. 2020

Fingeraftryk

Dyk ned i forskningsemnerne om 'Improved External Speaker-Robust Keyword Spotting for Hearing Assistive Devices'. Sammen danner de et unikt fingeraftryk.

Citationsformater