Immersive audio programming in a virtual reality sandbox

Nikolaj Andersson, Cumhur Erkut*, Stefania Serafin

*Corresponding author

Research output: Contribution to conference without publisher/journalPaper without publisher/journalResearchpeer-review

1 Citation (Scopus)

Abstract

Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch. © 2019 Audio Engineering Society. All rights reserved.
Original languageEnglish
Publication date1 Jan 2019
Publication statusPublished - 1 Jan 2019
Event2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience - York, United Kingdom
Duration: 27 Mar 201929 Mar 2019

Conference

Conference2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience
CountryUnited Kingdom
CityYork
Period27/03/201929/03/2019
Sponsoret al., Facebook Reality Labs, Genelec, iZOTOPE, KP Acoustics, YouTube

Fingerprint

Virtual reality
Musical instruments
Steam
Acoustic waves

Cite this

Andersson, N., Erkut, C., & Serafin, S. (2019). Immersive audio programming in a virtual reality sandbox. Paper presented at 2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience, York, United Kingdom.
Andersson, Nikolaj ; Erkut, Cumhur ; Serafin, Stefania. / Immersive audio programming in a virtual reality sandbox. Paper presented at 2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience, York, United Kingdom.
@conference{aa1729c7757b43d3ab2d73b8a52ed2a9,
title = "Immersive audio programming in a virtual reality sandbox",
abstract = "Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch. {\circledC} 2019 Audio Engineering Society. All rights reserved.",
author = "Nikolaj Andersson and Cumhur Erkut and Stefania Serafin",
year = "2019",
month = "1",
day = "1",
language = "English",
note = "2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience ; Conference date: 27-03-2019 Through 29-03-2019",

}

Andersson, N, Erkut, C & Serafin, S 2019, 'Immersive audio programming in a virtual reality sandbox', Paper presented at 2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience, York, United Kingdom, 27/03/2019 - 29/03/2019.

Immersive audio programming in a virtual reality sandbox. / Andersson, Nikolaj; Erkut, Cumhur; Serafin, Stefania.

2019. Paper presented at 2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience, York, United Kingdom.

Research output: Contribution to conference without publisher/journalPaper without publisher/journalResearchpeer-review

TY - CONF

T1 - Immersive audio programming in a virtual reality sandbox

AU - Andersson, Nikolaj

AU - Erkut, Cumhur

AU - Serafin, Stefania

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch. © 2019 Audio Engineering Society. All rights reserved.

AB - Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch. © 2019 Audio Engineering Society. All rights reserved.

UR - http://www.scopus.com/inward/record.url?scp=85067867658&partnerID=8YFLogxK

UR - http://www.aes.org/conferences/2019/immersive/

M3 - Paper without publisher/journal

AN - SCOPUS:85067867658

ER -

Andersson N, Erkut C, Serafin S. Immersive audio programming in a virtual reality sandbox. 2019. Paper presented at 2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience, York, United Kingdom.