Shouted and Whispered Speech Compensation for Speaker Verification Systems

Santiago Prieto-Calero, Alfonso Ortega, Ivan Lopez Espejo, Eduardo Lleida

Research output: Contribution to journalJournal articleResearchpeer-review

1 Citation (Scopus)

Abstract

Nowadays, speaker verification systems begin to perform very well under normal speech conditions due to the plethora of neutrally-phonated speech data available, which are used to train such systems. Nevertheless, the use of vocal effort modes other than normal severely degrades performance because of vocal effort mismatch. In this paper, in which we consider whispered, normal and shouted speech production modes, we first study how vocal effort mismatch negatively affects speaker verification performance. Then, in order to mitigate this issue, we describe a series of techniques for score calibration and speaker embedding compensation relying on logistic regression-based vocal effort mode detection. To test the validity of all of these methodologies, speaker verification experiments using a modern x-vector-based speaker verification system are carried out. Experimental results show that we can achieve, when combining score calibration and embedding compensation relying upon vocal effort mode detection, up to 19% and 52% equal error rate (EER) relative improvements under the shouted-normal and whispered-normal scenarios, respectively, in comparison with a system applying neither calibration nor compensation. Compared to our previous work [1], we obtain a 7.3% relative improvement in terms of EER when adding score calibration in shouted-normal All vs. All condition.
Original languageEnglish
Article number103536
JournalDigital Signal Processing: A Review Journal
Volume127
ISSN1051-2004
DOIs
Publication statusPublished - Jul 2022

Keywords

  • Deep learning
  • Domain compensation
  • Shouted speech
  • Speaker verification
  • Vocal effort mismatch
  • Whispered speech

Fingerprint

Dive into the research topics of 'Shouted and Whispered Speech Compensation for Speaker Verification Systems'. Together they form a unique fingerprint.

Cite this