Spatial Sound and Multimodal Interaction in Immersive Environments

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

3 Citations (Scopus)

Abstract

Spatial sound and interactivity are key elements of investigation at the Sound And Music Computing master program at Aalborg University Copenhagen.
We present a collection of research directions and recent results from work in these areas, with the focus on our multi- faceted approaches to two primary problem areas: 1) creation of interactive spatial audio experiences for immersive virtual and augmented reality scenarios, and 2) production and mixing of spatial audio for cinema, music, and other artistic contexts. Several ongoing research projects are described, wherein the latest developments are discussed.
These include elements in which we have provided sonic interaction in virtual environments, interactivity with volumetric sound sources using VBAP and Wave Field Synthesis (WFS), and binaural sound for virtual environments and spatial audio mixing. We show that the variety of approaches presented here are necessary in order to optimize interactivity with spatial audio for each particular type of task.
Original languageEnglish
Title of host publicationProceedings of the 9th Audio Mostly Conference on Interaction With Sound
Number of pages5
Place of PublicationThessaloniki, Greece
PublisherAssociation for Computing Machinery
Publication date7 Oct 2015
Article number17
ISBN (Electronic)978-1-4503-3896-7
DOIs
Publication statusPublished - 7 Oct 2015
EventAudio Mostly 2015: A Conference on Interaction With Sound - Thessaloniki, Greece
Duration: 7 Oct 20159 Oct 2015
Conference number: 9

Conference

ConferenceAudio Mostly 2015
Number9
CountryGreece
CityThessaloniki
Period07/10/201509/10/2015

Fingerprint

music
wave field
sound
research project
programme

Keywords

  • Multimodal interaction
  • Virtual environments
  • Spatial sound
  • Binaural sound
  • Wave field synthesis

Cite this

Grani, F., Overholt, D., Erkut, C., Gelineck, S., Triantafyllidis, G., Nordahl, R., & Serafin, S. (2015). Spatial Sound and Multimodal Interaction in Immersive Environments. In Proceedings of the 9th Audio Mostly Conference on Interaction With Sound [17] Thessaloniki, Greece: Association for Computing Machinery. https://doi.org/10.1145/2814895.2814919
Grani, Francesco ; Overholt, Daniel ; Erkut, Cumhur ; Gelineck, Steven ; Triantafyllidis, Georgios ; Nordahl, Rolf ; Serafin, Stefania. / Spatial Sound and Multimodal Interaction in Immersive Environments. Proceedings of the 9th Audio Mostly Conference on Interaction With Sound. Thessaloniki, Greece : Association for Computing Machinery, 2015.
@inproceedings{0f8df8f5ac5a436eb498e992d169d7d4,
title = "Spatial Sound and Multimodal Interaction in Immersive Environments",
abstract = "Spatial sound and interactivity are key elements of investigation at the Sound And Music Computing master program at Aalborg University Copenhagen.We present a collection of research directions and recent results from work in these areas, with the focus on our multi- faceted approaches to two primary problem areas: 1) creation of interactive spatial audio experiences for immersive virtual and augmented reality scenarios, and 2) production and mixing of spatial audio for cinema, music, and other artistic contexts. Several ongoing research projects are described, wherein the latest developments are discussed.These include elements in which we have provided sonic interaction in virtual environments, interactivity with volumetric sound sources using VBAP and Wave Field Synthesis (WFS), and binaural sound for virtual environments and spatial audio mixing. We show that the variety of approaches presented here are necessary in order to optimize interactivity with spatial audio for each particular type of task.",
keywords = "Multimodal interaction, Virtual environments, Spatial sound, Binaural sound, Wave field synthesis",
author = "Francesco Grani and Daniel Overholt and Cumhur Erkut and Steven Gelineck and Georgios Triantafyllidis and Rolf Nordahl and Stefania Serafin",
year = "2015",
month = "10",
day = "7",
doi = "10.1145/2814895.2814919",
language = "English",
booktitle = "Proceedings of the 9th Audio Mostly Conference on Interaction With Sound",
publisher = "Association for Computing Machinery",
address = "United States",

}

Grani, F, Overholt, D, Erkut, C, Gelineck, S, Triantafyllidis, G, Nordahl, R & Serafin, S 2015, Spatial Sound and Multimodal Interaction in Immersive Environments. in Proceedings of the 9th Audio Mostly Conference on Interaction With Sound., 17, Association for Computing Machinery, Thessaloniki, Greece, Audio Mostly 2015, Thessaloniki, Greece, 07/10/2015. https://doi.org/10.1145/2814895.2814919

Spatial Sound and Multimodal Interaction in Immersive Environments. / Grani, Francesco; Overholt, Daniel; Erkut, Cumhur; Gelineck, Steven; Triantafyllidis, Georgios; Nordahl, Rolf; Serafin, Stefania.

Proceedings of the 9th Audio Mostly Conference on Interaction With Sound. Thessaloniki, Greece : Association for Computing Machinery, 2015. 17.

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

TY - GEN

T1 - Spatial Sound and Multimodal Interaction in Immersive Environments

AU - Grani, Francesco

AU - Overholt, Daniel

AU - Erkut, Cumhur

AU - Gelineck, Steven

AU - Triantafyllidis, Georgios

AU - Nordahl, Rolf

AU - Serafin, Stefania

PY - 2015/10/7

Y1 - 2015/10/7

N2 - Spatial sound and interactivity are key elements of investigation at the Sound And Music Computing master program at Aalborg University Copenhagen.We present a collection of research directions and recent results from work in these areas, with the focus on our multi- faceted approaches to two primary problem areas: 1) creation of interactive spatial audio experiences for immersive virtual and augmented reality scenarios, and 2) production and mixing of spatial audio for cinema, music, and other artistic contexts. Several ongoing research projects are described, wherein the latest developments are discussed.These include elements in which we have provided sonic interaction in virtual environments, interactivity with volumetric sound sources using VBAP and Wave Field Synthesis (WFS), and binaural sound for virtual environments and spatial audio mixing. We show that the variety of approaches presented here are necessary in order to optimize interactivity with spatial audio for each particular type of task.

AB - Spatial sound and interactivity are key elements of investigation at the Sound And Music Computing master program at Aalborg University Copenhagen.We present a collection of research directions and recent results from work in these areas, with the focus on our multi- faceted approaches to two primary problem areas: 1) creation of interactive spatial audio experiences for immersive virtual and augmented reality scenarios, and 2) production and mixing of spatial audio for cinema, music, and other artistic contexts. Several ongoing research projects are described, wherein the latest developments are discussed.These include elements in which we have provided sonic interaction in virtual environments, interactivity with volumetric sound sources using VBAP and Wave Field Synthesis (WFS), and binaural sound for virtual environments and spatial audio mixing. We show that the variety of approaches presented here are necessary in order to optimize interactivity with spatial audio for each particular type of task.

KW - Multimodal interaction

KW - Virtual environments

KW - Spatial sound

KW - Binaural sound

KW - Wave field synthesis

U2 - 10.1145/2814895.2814919

DO - 10.1145/2814895.2814919

M3 - Article in proceeding

BT - Proceedings of the 9th Audio Mostly Conference on Interaction With Sound

PB - Association for Computing Machinery

CY - Thessaloniki, Greece

ER -

Grani F, Overholt D, Erkut C, Gelineck S, Triantafyllidis G, Nordahl R et al. Spatial Sound and Multimodal Interaction in Immersive Environments. In Proceedings of the 9th Audio Mostly Conference on Interaction With Sound. Thessaloniki, Greece: Association for Computing Machinery. 2015. 17 https://doi.org/10.1145/2814895.2814919