Immersive audio programming in a virtual reality sandbox

Nikolaj Andersson, Cumhur Erkut*, Stefania Serafin

*Corresponding author

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

1 Citation (Scopus)

Abstract

Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch. © 2019 Audio Engineering Society. All rights reserved.
Original languageEnglish
Title of host publication2019 AES International Conference on Immersive and Interactive Audio
PublisherAudio Engineering Society
Publication date1 Jan 2019
Article number6
Publication statusPublished - 1 Jan 2019
Event2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience - York, United Kingdom
Duration: 27 Mar 201929 Mar 2019

Conference

Conference2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience
CountryUnited Kingdom
CityYork
Period27/03/201929/03/2019
Sponsoret al., Facebook Reality Labs, Genelec, iZOTOPE, KP Acoustics, YouTube

Fingerprint Dive into the research topics of 'Immersive audio programming in a virtual reality sandbox'. Together they form a unique fingerprint.

Cite this