Audio system using binaural synthesis for multimodal telepresence applications

Esben Madsen, Milos Markovic, Søren Krarup Olesen, Pablo F. Hoffmann, Dorte Hammershøi

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceabstrakt i proceedingForskningpeer review

Resumé

An audio system was developed as part of a multimodal system aiming to go beyond current state of the art in telepresence.This paper provides an overview of how the audio was implemented and documents measurements that were performed on the audio system. The measurements include equalization of microphones, headphones and loudspeakers as well as measurements of network latency and bandwidth requirements of the system. Furthermore, measurements were made to determine whether the level of echo and
cross talk cause any issues. The overall system employs multiple modalities to virtually transport a person (the visitor) to a different physical location (the destination). The goal is that both the visitor and the people physically at the destination (the locals) should be provided with a sensation that the visitor is really there. Both the general multimodal system and the auditory part are implemented in a distributed manner. Body-tracking of all participants is provided through the system for the purpose of using binaural synthesis for directional sound. Head-worn microphones are used to capture sound, and the visitor is provided with directional sound through headphones. The visitor is represented to the locals through a physical representation (eg. a
robot) with a loudspeaker.
OriginalsprogEngelsk
TitelProceedings of the International Conference on Acoustics AIA-DAGA 2013
Udgivelses stedBerlin
ForlagDeutsche Gesellschafft für Akustik e.V. (DEGA)
Publikationsdato2013
ISBN (Trykt)978-3-939296-05-8
StatusUdgivet - 2013
BegivenhedAIA-DAGA 2013: Conference on Acoustics - Kurhaus, Merano, Italien
Varighed: 18 mar. 201321 mar. 2013

Konference

KonferenceAIA-DAGA 2013
LokationKurhaus
LandItalien
ByMerano
Periode18/03/201321/03/2013

Fingerprint

Audio systems
Headphones
Loudspeakers
Acoustic waves
Microphones
Robots
Bandwidth

Bibliografisk note

Structured session: Virtual acoustics 3

Citer dette

Madsen, E., Markovic, M., Olesen, S. K., Hoffmann, P. F., & Hammershøi, D. (2013). Audio system using binaural synthesis for multimodal telepresence applications. I Proceedings of the International Conference on Acoustics AIA-DAGA 2013 Berlin: Deutsche Gesellschafft für Akustik e.V. (DEGA).
Madsen, Esben ; Markovic, Milos ; Olesen, Søren Krarup ; Hoffmann, Pablo F. ; Hammershøi, Dorte. / Audio system using binaural synthesis for multimodal telepresence applications. Proceedings of the International Conference on Acoustics AIA-DAGA 2013. Berlin : Deutsche Gesellschafft für Akustik e.V. (DEGA), 2013.
@inbook{53db2dad182f46a390baa708fd9e1d7a,
title = "Audio system using binaural synthesis for multimodal telepresence applications",
abstract = "An audio system was developed as part of a multimodal system aiming to go beyond current state of the art in telepresence.This paper provides an overview of how the audio was implemented and documents measurements that were performed on the audio system. The measurements include equalization of microphones, headphones and loudspeakers as well as measurements of network latency and bandwidth requirements of the system. Furthermore, measurements were made to determine whether the level of echo and cross talk cause any issues. The overall system employs multiple modalities to virtually transport a person (the visitor) to a different physical location (the destination). The goal is that both the visitor and the people physically at the destination (the locals) should be provided with a sensation that the visitor is really there. Both the general multimodal system and the auditory part are implemented in a distributed manner. Body-tracking of all participants is provided through the system for the purpose of using binaural synthesis for directional sound. Head-worn microphones are used to capture sound, and the visitor is provided with directional sound through headphones. The visitor is represented to the locals through a physical representation (eg. a robot) with a loudspeaker.",
author = "Esben Madsen and Milos Markovic and Olesen, {S{\o}ren Krarup} and Hoffmann, {Pablo F.} and Dorte Hammersh{\o}i",
note = "Structured session: Virtual acoustics 3",
year = "2013",
language = "English",
isbn = "978-3-939296-05-8",
booktitle = "Proceedings of the International Conference on Acoustics AIA-DAGA 2013",
publisher = "Deutsche Gesellschafft f{\"u}r Akustik e.V. (DEGA)",

}

Madsen, E, Markovic, M, Olesen, SK, Hoffmann, PF & Hammershøi, D 2013, Audio system using binaural synthesis for multimodal telepresence applications. i Proceedings of the International Conference on Acoustics AIA-DAGA 2013. Deutsche Gesellschafft für Akustik e.V. (DEGA), Berlin, AIA-DAGA 2013, Merano, Italien, 18/03/2013.

Audio system using binaural synthesis for multimodal telepresence applications. / Madsen, Esben; Markovic, Milos; Olesen, Søren Krarup; Hoffmann, Pablo F.; Hammershøi, Dorte.

Proceedings of the International Conference on Acoustics AIA-DAGA 2013. Berlin : Deutsche Gesellschafft für Akustik e.V. (DEGA), 2013.

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceabstrakt i proceedingForskningpeer review

TY - ABST

T1 - Audio system using binaural synthesis for multimodal telepresence applications

AU - Madsen, Esben

AU - Markovic, Milos

AU - Olesen, Søren Krarup

AU - Hoffmann, Pablo F.

AU - Hammershøi, Dorte

N1 - Structured session: Virtual acoustics 3

PY - 2013

Y1 - 2013

N2 - An audio system was developed as part of a multimodal system aiming to go beyond current state of the art in telepresence.This paper provides an overview of how the audio was implemented and documents measurements that were performed on the audio system. The measurements include equalization of microphones, headphones and loudspeakers as well as measurements of network latency and bandwidth requirements of the system. Furthermore, measurements were made to determine whether the level of echo and cross talk cause any issues. The overall system employs multiple modalities to virtually transport a person (the visitor) to a different physical location (the destination). The goal is that both the visitor and the people physically at the destination (the locals) should be provided with a sensation that the visitor is really there. Both the general multimodal system and the auditory part are implemented in a distributed manner. Body-tracking of all participants is provided through the system for the purpose of using binaural synthesis for directional sound. Head-worn microphones are used to capture sound, and the visitor is provided with directional sound through headphones. The visitor is represented to the locals through a physical representation (eg. a robot) with a loudspeaker.

AB - An audio system was developed as part of a multimodal system aiming to go beyond current state of the art in telepresence.This paper provides an overview of how the audio was implemented and documents measurements that were performed on the audio system. The measurements include equalization of microphones, headphones and loudspeakers as well as measurements of network latency and bandwidth requirements of the system. Furthermore, measurements were made to determine whether the level of echo and cross talk cause any issues. The overall system employs multiple modalities to virtually transport a person (the visitor) to a different physical location (the destination). The goal is that both the visitor and the people physically at the destination (the locals) should be provided with a sensation that the visitor is really there. Both the general multimodal system and the auditory part are implemented in a distributed manner. Body-tracking of all participants is provided through the system for the purpose of using binaural synthesis for directional sound. Head-worn microphones are used to capture sound, and the visitor is provided with directional sound through headphones. The visitor is represented to the locals through a physical representation (eg. a robot) with a loudspeaker.

M3 - Conference abstract in proceeding

SN - 978-3-939296-05-8

BT - Proceedings of the International Conference on Acoustics AIA-DAGA 2013

PB - Deutsche Gesellschafft für Akustik e.V. (DEGA)

CY - Berlin

ER -

Madsen E, Markovic M, Olesen SK, Hoffmann PF, Hammershøi D. Audio system using binaural synthesis for multimodal telepresence applications. I Proceedings of the International Conference on Acoustics AIA-DAGA 2013. Berlin: Deutsche Gesellschafft für Akustik e.V. (DEGA). 2013