Setup for demonstrating interactive binaural synthesis for telepresence applications

Esben Madsen, Søren Krarup Olesen, Milos Markovic, Pablo F. Hoffmann, Dorte Hammershøi

Research output: Contribution to journalConference abstract in journalResearchpeer-review

736 Downloads (Pure)

Abstract

In the telepresence research project BEAMING, a prototype system has been set up to demonstrate basic audio and video interaction between two distant locations: the Destination, where 2 Locals are present and the Visitor Site where 1 Visitor is present. This paper describes the auditory parts of this system as well as interfaces to relevant parts of the complete system, including tracking and network streaming.

In the demonstration, the Visitor is wearing headphones and a microphone. At the Destination, the two Locals are both wearing a microphone, while the Visitor is represented using a fixed position Totem with a single loudspeaker. The Position and movements of participants, particularly the head, are tracked and from this sound is rendered to include binaural cues so the Visitor is able to move around in a limited space while perceiving Destination sound as "stationary".

This setup includes 3 main tasks:
Tracking coordinates are combined to calculate directions. This is handled by sharing "global" coordinates across the sites and adding local changes with a low latency, ending with a "direction of sound" for each source. Audio is recorded and transmitted over network. Here bandwidth, latency and transmission reliablity must be adjusted to obtain the best compromise. Bandwidth use and reliablity can be improved at the cost of latency. Finally the binaural synthesis for each source is processed at the listener's site (here Visitor) to have a minimum latency on responding to movement. The combined system is evaluated by the experience of the test users.

Original languageEnglish
JournalAcustica United with Acta Acustica
Volume97
Issue numberSupplement 1
Pages (from-to)S 90
ISSN1610-1928
Publication statusPublished - 2011
EventForum Acusticum 2011 - Aalborg, Denmark
Duration: 27 Jun 20111 Jul 2011
Conference number: 6

Conference

ConferenceForum Acusticum 2011
Number6
CountryDenmark
CityAalborg
Period27/06/201101/07/2011

Fingerprint

Dive into the research topics of 'Setup for demonstrating interactive binaural synthesis for telepresence applications'. Together they form a unique fingerprint.
  • BEAMING

    Olesen, S. K., Madsen, E., Markovic, M., Hammershøi, D. & Hoffmann, P. F.

    01/02/201001/08/2014

    Project: Research

Cite this