The Role of Lombard Speech and Gaze Behavior in Multi-Talker Conversations

Mark Dourado*, Henrik Gert Hassager, Jesper Udesen, Stefania Serafin

*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

Abstract

Effective communication with multiple conversational partners in cocktail party conditions can be attributed to successful auditory scene analysis. Talkers unconsciously adjust to adverse settings by introducing both verbal and non-verbal strategies, such as the Lombard effect. The Lombard effect has traditionally been defined as an increase in vocal intensity as a response to noise, with the purpose of increasing self-monitoring for the talker and intelligibility for conversational partners. To assess how the Lombard effect is utilized in multimodal communication, speech and gaze data were collected from four multi-talker groups with pre-established relationships. Each group had casual conversations in both quiet settings and scenarios with external babble noise. Results show that fifteen out of sixteen talkers exhibited an average increase in loudness during interruptive speech in all conditions withand without external babble noise when compared to unchallenged sections of speech. Comparing gaze behavior during periods of a talkers own speech to periods of silence showed that the majority of talkers had more active gaze when speaking.

Original languageEnglish
Title of host publicationAES International Conference on Audio for Virtual and Augmented Reality, AVAR 2022
Number of pages10
PublisherAudio Engineering Society
Publication date2022
Pages195-204
ISBN (Electronic)9781713859727
Publication statusPublished - 2022
Event2022 AES International Conference on Audio for Virtual and Augmented Reality, AVAR 2022 - Redmond, United States
Duration: 15 Aug 202217 Aug 2022

Conference

Conference2022 AES International Conference on Audio for Virtual and Augmented Reality, AVAR 2022
Country/TerritoryUnited States
CityRedmond
Period15/08/202217/08/2022
SeriesProceedings of the AES International Conference
Volume2022-August

Bibliographical note

Publisher Copyright:
© 2022 Audio Engineering Society. All rights reserved.

Fingerprint

Dive into the research topics of 'The Role of Lombard Speech and Gaze Behavior in Multi-Talker Conversations'. Together they form a unique fingerprint.

Cite this