Immersive audio programming in a virtual reality sandbox

Nikolaj Andersson, Cumhur Erkut*, Stefania Serafin

*Kontaktforfatter

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

1 Citation (Scopus)

Resumé

Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch. © 2019 Audio Engineering Society. All rights reserved.
OriginalsprogEngelsk
Titel2019 AES International Conference on Immersive and Interactive Audio
ForlagAudio Engineering Society
Publikationsdato1 jan. 2019
Artikelnummer6
StatusUdgivet - 1 jan. 2019
Begivenhed2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience - York, Storbritannien
Varighed: 27 mar. 201929 mar. 2019

Konference

Konference2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience
LandStorbritannien
ByYork
Periode27/03/201929/03/2019
Sponsoret al., Facebook Reality Labs, Genelec, iZOTOPE, KP Acoustics, YouTube

Fingerprint

Virtual reality
Musical instruments
Steam
Acoustic waves

Citer dette

Andersson, N., Erkut, C., & Serafin, S. (2019). Immersive audio programming in a virtual reality sandbox. I 2019 AES International Conference on Immersive and Interactive Audio [6] Audio Engineering Society.
Andersson, Nikolaj ; Erkut, Cumhur ; Serafin, Stefania. / Immersive audio programming in a virtual reality sandbox. 2019 AES International Conference on Immersive and Interactive Audio. Audio Engineering Society, 2019.
@inproceedings{aa1729c7757b43d3ab2d73b8a52ed2a9,
title = "Immersive audio programming in a virtual reality sandbox",
abstract = "Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch. {\circledC} 2019 Audio Engineering Society. All rights reserved.",
author = "Nikolaj Andersson and Cumhur Erkut and Stefania Serafin",
year = "2019",
month = "1",
day = "1",
language = "English",
booktitle = "2019 AES International Conference on Immersive and Interactive Audio",
publisher = "Audio Engineering Society",

}

Andersson, N, Erkut, C & Serafin, S 2019, Immersive audio programming in a virtual reality sandbox. i 2019 AES International Conference on Immersive and Interactive Audio., 6, Audio Engineering Society, 2019 AES International Conference on Immersive and Interactive Audio: Creating the Next Dimension of Sound Experience, York, Storbritannien, 27/03/2019.

Immersive audio programming in a virtual reality sandbox. / Andersson, Nikolaj; Erkut, Cumhur; Serafin, Stefania.

2019 AES International Conference on Immersive and Interactive Audio. Audio Engineering Society, 2019. 6.

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

TY - GEN

T1 - Immersive audio programming in a virtual reality sandbox

AU - Andersson, Nikolaj

AU - Erkut, Cumhur

AU - Serafin, Stefania

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch. © 2019 Audio Engineering Society. All rights reserved.

AB - Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch. © 2019 Audio Engineering Society. All rights reserved.

UR - http://www.scopus.com/inward/record.url?scp=85067867658&partnerID=8YFLogxK

UR - http://www.aes.org/conferences/2019/immersive/

M3 - Article in proceeding

AN - SCOPUS:85067867658

BT - 2019 AES International Conference on Immersive and Interactive Audio

PB - Audio Engineering Society

ER -

Andersson N, Erkut C, Serafin S. Immersive audio programming in a virtual reality sandbox. I 2019 AES International Conference on Immersive and Interactive Audio. Audio Engineering Society. 2019. 6