Nonintrusive Speech Intelligibility Prediction Using Convolutional Neural Networks

Asger Heidemann Andersen, Jan Mark De Haan, Zheng-Hua Tan, Jesper Jensen

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

6 Citationer (Scopus)
111 Downloads (Pure)


Speech Intelligibility Prediction (SIP) algorithms are becoming popular tools within the development and operation of speech processing devices and algorithms. However, many SIP algorithms require knowledge of the underlying clean speech; a signal that is often not available in real-world applications. This has led to increased interest in nonintrusive SIP algorithms, which do not require clean speech to make predictions. In this paper, we investigate the use of Convolutional Neural Networks (CNNs) for nonintrusive SIP. To do so, we utilize a CNN architecture that shows similarities to existing SIP algorithms, in terms of computational structure, and which allows for easy and meaningful visualization and interpretation of trained weights. We evaluate this architecture using a large dataset obtained by combining datasets from the literature. The proposed method shows high prediction performance when compared with four existing intrusive and nonintrusive SIP algorithms. This demonstrates the potential of deep learning for speech intelligibility prediction.

TidsskriftIEEE/ACM Transactions on Audio, Speech, and Language Processing
Udgave nummer10
Sider (fra-til)1925-1939
Antal sider15
StatusUdgivet - okt. 2018

Fingeraftryk Dyk ned i forskningsemnerne om 'Nonintrusive Speech Intelligibility Prediction Using Convolutional Neural Networks'. Sammen danner de et unikt fingeraftryk.

  • Citationsformater