Improved External Speaker-Robust Keyword Spotting for Hearing Assistive Devices

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

For certain applications, keyword spotting (KWS) requires some degree of personalization. This is the case for KWS for hearing assistive devices, e.g., hearing aids, where only the device user should be allowed to trigger the KWS system. In this paper, we first develop a new realistic hearing aid experimental framework. Next, using this framework we show that the performance of a state-of-the-art multi-task deep learning architecture exploiting cepstral features for joint KWS and users' own-voice/external speaker detection drops significantly. To overcome this problem, we use phase difference information through GCC-PHAT (Generalized Cross-Correlation with PHAse Transform)-based coefficients along with log-spectral magnitude features. In addition, we demonstrate that working in the perceptually-motivated constant-Q transform (CQT) domain instead of in the short-time Fourier transform (STFT) domain allows for the generation of compact and coherent features which provide superior KWS performance. Our experimental results show that our CQT-based proposal achieves a relative KWS accuracy improvement of around 18% compared to using cepstral features while dramatically decreasing the number of multiplications in the multi-task architecture, which is key in the context of low-resource devices like hearing assistive devices.

Original languageEnglish
Article number9054977
JournalIEEE/ACM Transactions on Audio, Speech, and Language Processing
Volume28
Pages (from-to)1233-1247
Number of pages15
ISSN2329-9290
DOIs
Publication statusPublished - Apr 2020

Keywords

  • Constant-Q transform
  • External speaker
  • Generalized cross-correlation
  • Hearing assistive device
  • Multi-task learning
  • Robust keyword spotting

Fingerprint Dive into the research topics of 'Improved External Speaker-Robust Keyword Spotting for Hearing Assistive Devices'. Together they form a unique fingerprint.

  • Cite this