Abstract

A high-fidelity but efficient sound simulation is an essential element of any VR experience. Many of the techniques used in virtual acoustics are graphical rendering techniques suitably modified to account for sound generation and propagation. In recent years, several advances in hardware and software technologies have been facilitating the development of immersive interactive sound-rendering experiences. In this article, we present a review of the state of the art of such simulations, with a focus on the different elements that, combined, provide a complete interactive sonic experience. This includes physics-based simulation of sound effects and their propagation in space together with binaural rendering to simulate the position of sound sources. We present how these different elements of the sound design pipeline have been addressed in the literature, trying to find the trade-off between accuracy and plausibility. Recent applications and current challenges are also presented.

Original languageEnglish
JournalI E E E Computer Graphics and Applications
Volume38
Issue number2
Pages (from-to)31-43
Number of pages13
ISSN0272-1716
DOIs
Publication statusPublished - Apr 2018

Fingerprint

Virtual reality
Acoustic waves
Physics
Pipelines
Acoustics
Hardware

Keywords

  • computer graphics
  • head-related transfer function
  • sonic interaction
  • sound rendering

Cite this

@article{8748406d3b8c4e79867027ff5d9e1a37,
title = "Sonic Interactions in Virtual Reality: State of the art, current challenges and future directions",
abstract = "A high-fidelity but efficient sound simulation is an essential element of any VR experience. Many of the techniques used in virtual acoustics are graphical rendering techniques suitably modified to account for sound generation and propagation. In recent years, several advances in hardware and software technologies have been facilitating the development of immersive interactive sound-rendering experiences. In this article, we present a review of the state of the art of such simulations, with a focus on the different elements that, combined, provide a complete interactive sonic experience. This includes physics-based simulation of sound effects and their propagation in space together with binaural rendering to simulate the position of sound sources. We present how these different elements of the sound design pipeline have been addressed in the literature, trying to find the trade-off between accuracy and plausibility. Recent applications and current challenges are also presented.",
keywords = "computer graphics, head-related transfer function, sonic interaction, sound rendering",
author = "Stefania Serafin and Michele Geronazzo and Cumhur Erkut and Nilsson, {Niels Chr.} and Rolf Nordahl",
year = "2018",
month = "4",
doi = "10.1109/MCG.2018.193142628",
language = "English",
volume = "38",
pages = "31--43",
journal = "I E E E Computer Graphics and Applications",
issn = "0272-1716",
publisher = "IEEE",
number = "2",

}

TY - JOUR

T1 - Sonic Interactions in Virtual Reality

T2 - State of the art, current challenges and future directions

AU - Serafin, Stefania

AU - Geronazzo, Michele

AU - Erkut, Cumhur

AU - Nilsson, Niels Chr.

AU - Nordahl, Rolf

PY - 2018/4

Y1 - 2018/4

N2 - A high-fidelity but efficient sound simulation is an essential element of any VR experience. Many of the techniques used in virtual acoustics are graphical rendering techniques suitably modified to account for sound generation and propagation. In recent years, several advances in hardware and software technologies have been facilitating the development of immersive interactive sound-rendering experiences. In this article, we present a review of the state of the art of such simulations, with a focus on the different elements that, combined, provide a complete interactive sonic experience. This includes physics-based simulation of sound effects and their propagation in space together with binaural rendering to simulate the position of sound sources. We present how these different elements of the sound design pipeline have been addressed in the literature, trying to find the trade-off between accuracy and plausibility. Recent applications and current challenges are also presented.

AB - A high-fidelity but efficient sound simulation is an essential element of any VR experience. Many of the techniques used in virtual acoustics are graphical rendering techniques suitably modified to account for sound generation and propagation. In recent years, several advances in hardware and software technologies have been facilitating the development of immersive interactive sound-rendering experiences. In this article, we present a review of the state of the art of such simulations, with a focus on the different elements that, combined, provide a complete interactive sonic experience. This includes physics-based simulation of sound effects and their propagation in space together with binaural rendering to simulate the position of sound sources. We present how these different elements of the sound design pipeline have been addressed in the literature, trying to find the trade-off between accuracy and plausibility. Recent applications and current challenges are also presented.

KW - computer graphics

KW - head-related transfer function

KW - sonic interaction

KW - sound rendering

UR - http://www.scopus.com/inward/record.url?scp=85045191223&partnerID=8YFLogxK

U2 - 10.1109/MCG.2018.193142628

DO - 10.1109/MCG.2018.193142628

M3 - Journal article

VL - 38

SP - 31

EP - 43

JO - I E E E Computer Graphics and Applications

JF - I E E E Computer Graphics and Applications

SN - 0272-1716

IS - 2

ER -