A linear MMSE filter using delayed remote microphone signals for speech enhancement in hearing aid applications

Vasudha Sathyapriyan; Michael Syskind Pedersen; Jan Østergaard; Mike Brooks; Patrick Naylor; Jesper Jensen

doi:10.1109/IWAENC53105.2022.9914711

A linear MMSE filter using delayed remote microphone signals for speech enhancement in hearing aid applications

Vasudha Sathyapriyan, Michael Syskind Pedersen, Jan Østergaard, Mike Brooks, Patrick Naylor, Jesper Jensen

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

1 Citation (Scopus)

40 Downloads (Pure)

Abstract

Existing methods that use remote microphones with hearing aid (HA) noise reduction systems, assume the wireless transmission to be instantaneous. In practice, however, there exists a time difference of arrival (TDOA) between the wirelessly transmitted target signals and the acoustic signal arriving from the target source to the HA device, which degrades their noise reduction performance. As speech is correlated between consecutive time-frames in the short-time Fourier transform (STFT) domain, we propose a linear minimum mean-square error (MMSE) estimator to estimate the desired signal, by combining multiple HA microphone signals with multiple consecutive time-frames of the remote microphone signal. We derive closed form expressions for the resulting filter weights and interpret them in terms of existing multi-channel and multi-frame methods. The simulation results validate the interpretation and show that using a multi-frame method along with a multi-channel method is an
advantage, in the presence of unknown, positive TDOA between the microphone signals.

Original language	English
Title of host publication	2022 International Workshop on Acoustic Signal Enhancement (IWAENC)
Publisher	IEEE
Publication date	5 Sept 2022
Article number	9914711
ISBN (Print)	978-1-6654-6868-8
ISBN (Electronic)	978-1-6654-6867-1
DOIs	https://doi.org/10.1109/IWAENC53105.2022.9914711
Publication status	Published - 5 Sept 2022
Event	2022 International Workshop on Acoustic Signal Enhancement (IWAENC) - Bamberg, Germany Duration: 5 Sept 2022 → 8 Sept 2022

Conference

Conference	2022 International Workshop on Acoustic Signal Enhancement (IWAENC)
Country/Territory	Germany
City	Bamberg
Period	05/09/2022 → 08/09/2022

Bibliographical note

This project has received funding from the European Union’s Horizon
2020 research and innovation programme under the Marie Skłodowska-Curie
grant agreement No. 956369.

Keywords

multi-microphone speech enhancement
multi-frame speech enhancement
Wireless acoustic sensor networks (WASNs)

Access to Document

10.1109/IWAENC53105.2022.9914711

IWAENC_2022_VASY_pre-printAccepted author manuscript, 271 KBLicence: Unspecified

AUB Link

Search for the material in Aalborg University Library's search engine

Cite this

@inproceedings{ba652d4c70ec41aeb098f88bf266f8ce,

title = "A linear MMSE filter using delayed remote microphone signals for speech enhancement in hearing aid applications",

abstract = "Existing methods that use remote microphones with hearing aid (HA) noise reduction systems, assume the wireless transmission to be instantaneous. In practice, however, there exists a time difference of arrival (TDOA) between the wirelessly transmitted target signals and the acoustic signal arriving from the target source to the HA device, which degrades their noise reduction performance. As speech is correlated between consecutive time-frames in the short-time Fourier transform (STFT) domain, we propose a linear minimum mean-square error (MMSE) estimator to estimate the desired signal, by combining multiple HA microphone signals with multiple consecutive time-frames of the remote microphone signal. We derive closed form expressions for the resulting filter weights and interpret them in terms of existing multi-channel and multi-frame methods. The simulation results validate the interpretation and show that using a multi-frame method along with a multi-channel method is anadvantage, in the presence of unknown, positive TDOA between the microphone signals.",

keywords = "multi-microphone speech enhancement, multi-frame speech enhancement, Wireless acoustic sensor networks (WASNs)",

author = "Vasudha Sathyapriyan and Pedersen, {Michael Syskind} and Jan {\O}stergaard and Mike Brooks and Patrick Naylor and Jesper Jensen",

note = "This project has received funding from the European Union{\textquoteright}s Horizon 2020 research and innovation programme under the Marie Sk{\l}odowska-Curie grant agreement No. 956369.; 2022 International Workshop on Acoustic Signal Enhancement (IWAENC) ; Conference date: 05-09-2022 Through 08-09-2022",

year = "2022",

month = sep,

day = "5",

doi = "10.1109/IWAENC53105.2022.9914711",

language = "English",

isbn = "978-1-6654-6868-8",

booktitle = "2022 International Workshop on Acoustic Signal Enhancement (IWAENC)",

publisher = "IEEE",

address = "United States",

}

Sathyapriyan, V, Pedersen, MS, Østergaard, J, Brooks, M, Naylor, P & Jensen, J 2022, A linear MMSE filter using delayed remote microphone signals for speech enhancement in hearing aid applications. in 2022 International Workshop on Acoustic Signal Enhancement (IWAENC)., 9914711, IEEE, 2022 International Workshop on Acoustic Signal Enhancement (IWAENC), Bamberg, Germany, 05/09/2022. https://doi.org/10.1109/IWAENC53105.2022.9914711

A linear MMSE filter using delayed remote microphone signals for speech enhancement in hearing aid applications. / Sathyapriyan, Vasudha; Pedersen, Michael Syskind; Østergaard, Jan et al.
2022 International Workshop on Acoustic Signal Enhancement (IWAENC). IEEE, 2022. 9914711.

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

TY - GEN

T1 - A linear MMSE filter using delayed remote microphone signals for speech enhancement in hearing aid applications

AU - Sathyapriyan, Vasudha

AU - Pedersen, Michael Syskind

AU - Østergaard, Jan

AU - Brooks, Mike

AU - Naylor, Patrick

AU - Jensen, Jesper

N1 - This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 956369.

PY - 2022/9/5

Y1 - 2022/9/5

N2 - Existing methods that use remote microphones with hearing aid (HA) noise reduction systems, assume the wireless transmission to be instantaneous. In practice, however, there exists a time difference of arrival (TDOA) between the wirelessly transmitted target signals and the acoustic signal arriving from the target source to the HA device, which degrades their noise reduction performance. As speech is correlated between consecutive time-frames in the short-time Fourier transform (STFT) domain, we propose a linear minimum mean-square error (MMSE) estimator to estimate the desired signal, by combining multiple HA microphone signals with multiple consecutive time-frames of the remote microphone signal. We derive closed form expressions for the resulting filter weights and interpret them in terms of existing multi-channel and multi-frame methods. The simulation results validate the interpretation and show that using a multi-frame method along with a multi-channel method is anadvantage, in the presence of unknown, positive TDOA between the microphone signals.

AB - Existing methods that use remote microphones with hearing aid (HA) noise reduction systems, assume the wireless transmission to be instantaneous. In practice, however, there exists a time difference of arrival (TDOA) between the wirelessly transmitted target signals and the acoustic signal arriving from the target source to the HA device, which degrades their noise reduction performance. As speech is correlated between consecutive time-frames in the short-time Fourier transform (STFT) domain, we propose a linear minimum mean-square error (MMSE) estimator to estimate the desired signal, by combining multiple HA microphone signals with multiple consecutive time-frames of the remote microphone signal. We derive closed form expressions for the resulting filter weights and interpret them in terms of existing multi-channel and multi-frame methods. The simulation results validate the interpretation and show that using a multi-frame method along with a multi-channel method is anadvantage, in the presence of unknown, positive TDOA between the microphone signals.

KW - multi-microphone speech enhancement

KW - multi-frame speech enhancement

KW - Wireless acoustic sensor networks (WASNs)

U2 - 10.1109/IWAENC53105.2022.9914711

DO - 10.1109/IWAENC53105.2022.9914711

M3 - Article in proceeding

SN - 978-1-6654-6868-8

BT - 2022 International Workshop on Acoustic Signal Enhancement (IWAENC)

PB - IEEE

T2 - 2022 International Workshop on Acoustic Signal Enhancement (IWAENC)

Y2 - 5 September 2022 through 8 September 2022

ER -

A linear MMSE filter using delayed remote microphone signals for speech enhancement in hearing aid applications

Abstract

Conference

Bibliographical note

Keywords

Access to Document

AUB Link

Fingerprint

Cite this