Creating an Audio Story with Interactive Binaural Rendering in Virtual Reality

Michele Geronazzo, Amalie Leopold Hyldig Rosenkvist, David Sebastian Eriksen, Camilla Kirstine Markmann-Hansen, Jeppe Køhlert, Miicha Valimaa, Mikkel Brogaard Vittrup, Stefania Serafin

Research output: Contribution to journalJournal articleResearchpeer-review

11 Downloads (Pure)

Abstract

The process of listening to an audiobook is usually a rather passive act that does not require an active interaction. If spatial interaction is incorporated into a storytelling scenario, can open. Possibilities of a novel experience which allows an active participation might affect the user-experience. The aim of this paper is to create a portable prototype system based on an embedded hardware platform, allowing listeners to get immersed in an interactive audio storytelling experience enhanced by dynamic binaural audio rendering. For the evaluation of the experience, a short story based on the horror narrative of Stephen King’s Strawberry Springs is adapted and designed in virtual environments. A comparison among three different listening experiences, namely, (i) monophonic (traditional audio story), (ii) static binaural rendering (state-of-the-art audio story), and (iii) our prototype, is conducted. We discuss the quality of the experience based on usability testing, physiological data, emotional assessments, and questionnaires for immersion and spatial presence. Results identify a clear trend for an increase in immersion with our prototype compared to traditional audiobooks, showing also an emphasis on story-specific emotions, i.e., terror and fear.
Original languageEnglish
Article number1463204
JournalWireless Communications and Mobile Computing (Print)
Volume2019
Number of pages14
ISSN1530-8669
DOIs
Publication statusPublished - Nov 2019

    Fingerprint

Cite this

Geronazzo, M., Leopold Hyldig Rosenkvist, A., Sebastian Eriksen, D., Markmann-Hansen, C. K., Køhlert, J., Valimaa, M., Brogaard Vittrup, M., & Serafin, S. (2019). Creating an Audio Story with Interactive Binaural Rendering in Virtual Reality. Wireless Communications and Mobile Computing (Print), 2019, [1463204]. https://doi.org/10.1155/2019/1463204