Auditory Feedback for Navigation with Echoes in Virtual Environments: Training Procedure and Orientation Strategies

Anastassia Andreasen, Michele Geronazzo, Niels Christian Nilsson, Jelizaveta Zovnercuka, Kristians Konovalovs, Stefania Serafin

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

12 Downloads (Pure)

Resumé

Being able to hear objects in an environment, for example using echolocation, is a challenging task. The main goal of the current work is to use virtual environments (VEs) to train novice users to navigate using echolocation. Previous studies have shown that musicians are able to differentiate sound pulses from reflections. This paper presents design patterns for VE simulators for both training and testing procedures, while classifying users' navigation strategies in the VE. Moreover, the paper presents features that increase users' performance in VEs. We report the findings of two user studies: a pilot test that helped improve the sonic interaction design, and a primary study exposing participants to a spatial orientation task during four conditions which were early reflections (RF), late reverberation (RV), early reflections-reverberation (RR) and visual stimuli (V). The latter study allowed us to identify navigation strategies among the users. Some users (10/26) reported an ability to create spatial cognitive maps during the test with auditory echoes, which may explain why this group performed better than the remaining participants in the RR condition.

OriginalsprogEngelsk
Artikelnummer8643846
TidsskriftI E E E Transactions on Visualization and Computer Graphics
Vol/bind25
Udgave nummer5
Sider (fra-til)1876-1886
Antal sider11
ISSN1077-2626
DOI
StatusUdgivet - 1 maj 2019

Fingerprint

Virtual reality
Reverberation
Navigation
Feedback
Simulators
Acoustic waves
Testing

Citer dette

@article{f2eabbf5b2894ca29a13d5d24c5e72e1,
title = "Auditory Feedback for Navigation with Echoes in Virtual Environments: Training Procedure and Orientation Strategies",
abstract = "Being able to hear objects in an environment, for example using echolocation, is a challenging task. The main goal of the current work is to use virtual environments (VEs) to train novice users to navigate using echolocation. Previous studies have shown that musicians are able to differentiate sound pulses from reflections. This paper presents design patterns for VE simulators for both training and testing procedures, while classifying users' navigation strategies in the VE. Moreover, the paper presents features that increase users' performance in VEs. We report the findings of two user studies: a pilot test that helped improve the sonic interaction design, and a primary study exposing participants to a spatial orientation task during four conditions which were early reflections (RF), late reverberation (RV), early reflections-reverberation (RR) and visual stimuli (V). The latter study allowed us to identify navigation strategies among the users. Some users (10/26) reported an ability to create spatial cognitive maps during the test with auditory echoes, which may explain why this group performed better than the remaining participants in the RR condition.",
keywords = "Human echolocation, binaural synthesis, navigation, sonic interactions, spatial audio, spatial cognition, virtual reality",
author = "Anastassia Andreasen and Michele Geronazzo and Nilsson, {Niels Christian} and Jelizaveta Zovnercuka and Kristians Konovalovs and Stefania Serafin",
year = "2019",
month = "5",
day = "1",
doi = "10.1109/TVCG.2019.2898787",
language = "English",
volume = "25",
pages = "1876--1886",
journal = "I E E E Transactions on Visualization and Computer Graphics",
issn = "1077-2626",
publisher = "IEEE",
number = "5",

}

Auditory Feedback for Navigation with Echoes in Virtual Environments: Training Procedure and Orientation Strategies. / Andreasen, Anastassia; Geronazzo, Michele; Nilsson, Niels Christian; Zovnercuka, Jelizaveta; Konovalovs, Kristians; Serafin, Stefania.

I: I E E E Transactions on Visualization and Computer Graphics, Bind 25, Nr. 5, 8643846, 01.05.2019, s. 1876-1886.

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

TY - JOUR

T1 - Auditory Feedback for Navigation with Echoes in Virtual Environments: Training Procedure and Orientation Strategies

AU - Andreasen, Anastassia

AU - Geronazzo, Michele

AU - Nilsson, Niels Christian

AU - Zovnercuka, Jelizaveta

AU - Konovalovs, Kristians

AU - Serafin, Stefania

PY - 2019/5/1

Y1 - 2019/5/1

N2 - Being able to hear objects in an environment, for example using echolocation, is a challenging task. The main goal of the current work is to use virtual environments (VEs) to train novice users to navigate using echolocation. Previous studies have shown that musicians are able to differentiate sound pulses from reflections. This paper presents design patterns for VE simulators for both training and testing procedures, while classifying users' navigation strategies in the VE. Moreover, the paper presents features that increase users' performance in VEs. We report the findings of two user studies: a pilot test that helped improve the sonic interaction design, and a primary study exposing participants to a spatial orientation task during four conditions which were early reflections (RF), late reverberation (RV), early reflections-reverberation (RR) and visual stimuli (V). The latter study allowed us to identify navigation strategies among the users. Some users (10/26) reported an ability to create spatial cognitive maps during the test with auditory echoes, which may explain why this group performed better than the remaining participants in the RR condition.

AB - Being able to hear objects in an environment, for example using echolocation, is a challenging task. The main goal of the current work is to use virtual environments (VEs) to train novice users to navigate using echolocation. Previous studies have shown that musicians are able to differentiate sound pulses from reflections. This paper presents design patterns for VE simulators for both training and testing procedures, while classifying users' navigation strategies in the VE. Moreover, the paper presents features that increase users' performance in VEs. We report the findings of two user studies: a pilot test that helped improve the sonic interaction design, and a primary study exposing participants to a spatial orientation task during four conditions which were early reflections (RF), late reverberation (RV), early reflections-reverberation (RR) and visual stimuli (V). The latter study allowed us to identify navigation strategies among the users. Some users (10/26) reported an ability to create spatial cognitive maps during the test with auditory echoes, which may explain why this group performed better than the remaining participants in the RR condition.

KW - Human echolocation

KW - binaural synthesis

KW - navigation

KW - sonic interactions

KW - spatial audio

KW - spatial cognition

KW - virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85061998449&partnerID=8YFLogxK

U2 - 10.1109/TVCG.2019.2898787

DO - 10.1109/TVCG.2019.2898787

M3 - Journal article

VL - 25

SP - 1876

EP - 1886

JO - I E E E Transactions on Visualization and Computer Graphics

JF - I E E E Transactions on Visualization and Computer Graphics

SN - 1077-2626

IS - 5

M1 - 8643846

ER -