Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality

Alex Baldwin; Stefania Serafin; Cumhur Erkut

doi:10.1109/SIVE.2018.8577129

Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality

Alex Baldwin, Stefania Serafin, Cumhur Erkut

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

4 Citations (Scopus)

Abstract

ScatAR is an augmented reality (AR) audio application, where scattering delay networks (SDNs) efficiently generate and organize a reverberator based on room geometry scanned by an AR device. Here we present a perceptual evaluation of the application in terms of auditory object presence. Specifically, we investigate the personal preferences on the auditory registration of a sounding object (a drone transmitting speech) in a room in anechoic versus artificial reverberation conditions. The results indicate a marginal preference of the reverberation, but much less than what we have anticipated. We discuss possible reasons for this, and set to compare our SDN implementation with a Waveguide Web (WGW) simulation in AR. While the WGWs are computationally more demanding, they have a potential to provide more accurate second-order reflections, and therefore, better registering of audio-visual AR scenes.

Original language	English
Title of host publication	2018 IEEE 4th VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018
Editors	Niels Christian Nilsson, Cumhur Erkut, Stefania Serafin, Federico Avanzini, Michele Geronazzo, Francesco Grani
Publisher	IEEE
Publication date	14 Dec 2018
Article number	8577129
ISBN (Electronic)	9781538657133
DOIs	https://doi.org/10.1109/SIVE.2018.8577129
Publication status	Published - 14 Dec 2018
Event	4th IEEE VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018 - Reutlingen, Germany Duration: 18 Mar 2018 → …

Conference

Conference	4th IEEE VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018
Country/Territory	Germany
City	Reutlingen
Period	18/03/2018 → …

Keywords

Auditory feedback
Human-centered computing
Mixed / augmented reality

Access to Document

10.1109/SIVE.2018.8577129

AUB Link

Search for the material in Aalborg University Library's search engine

Cite this

Baldwin, A., Serafin, S., & Erkut, C. (2018). Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality. In N. C. Nilsson, C. Erkut, S. Serafin, F. Avanzini, M. Geronazzo, & F. Grani (Eds.), 2018 IEEE 4th VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018 Article 8577129 IEEE. https://doi.org/10.1109/SIVE.2018.8577129

Baldwin, Alex ; Serafin, Stefania ; Erkut, Cumhur. / Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality. 2018 IEEE 4th VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018. editor / Niels Christian Nilsson ; Cumhur Erkut ; Stefania Serafin ; Federico Avanzini ; Michele Geronazzo ; Francesco Grani. IEEE, 2018.

@inproceedings{91b4d04f6b7749938656259c9e99aee7,

title = "Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality",

abstract = "ScatAR is an augmented reality (AR) audio application, where scattering delay networks (SDNs) efficiently generate and organize a reverberator based on room geometry scanned by an AR device. Here we present a perceptual evaluation of the application in terms of auditory object presence. Specifically, we investigate the personal preferences on the auditory registration of a sounding object (a drone transmitting speech) in a room in anechoic versus artificial reverberation conditions. The results indicate a marginal preference of the reverberation, but much less than what we have anticipated. We discuss possible reasons for this, and set to compare our SDN implementation with a Waveguide Web (WGW) simulation in AR. While the WGWs are computationally more demanding, they have a potential to provide more accurate second-order reflections, and therefore, better registering of audio-visual AR scenes.",

keywords = "Auditory feedback, Human-centered computing, Mixed / augmented reality",

author = "Alex Baldwin and Stefania Serafin and Cumhur Erkut",

year = "2018",

month = dec,

day = "14",

doi = "10.1109/SIVE.2018.8577129",

language = "English",

editor = "Nilsson, {Niels Christian} and Cumhur Erkut and Stefania Serafin and Federico Avanzini and Michele Geronazzo and Francesco Grani",

booktitle = "2018 IEEE 4th VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018",

publisher = "IEEE",

address = "United States",

note = "4th IEEE VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018 ; Conference date: 18-03-2018",

}

Baldwin, A, Serafin, S & Erkut, C 2018, Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality. in NC Nilsson, C Erkut, S Serafin, F Avanzini, M Geronazzo & F Grani (eds), 2018 IEEE 4th VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018., 8577129, IEEE, 4th IEEE VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018, Reutlingen, Germany, 18/03/2018. https://doi.org/10.1109/SIVE.2018.8577129

Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality. / Baldwin, Alex; Serafin, Stefania ; Erkut, Cumhur.
2018 IEEE 4th VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018. ed. / Niels Christian Nilsson; Cumhur Erkut; Stefania Serafin; Federico Avanzini; Michele Geronazzo; Francesco Grani. IEEE, 2018. 8577129.

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

TY - GEN

T1 - Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality

AU - Baldwin, Alex

AU - Serafin, Stefania

AU - Erkut, Cumhur

PY - 2018/12/14

Y1 - 2018/12/14

N2 - ScatAR is an augmented reality (AR) audio application, where scattering delay networks (SDNs) efficiently generate and organize a reverberator based on room geometry scanned by an AR device. Here we present a perceptual evaluation of the application in terms of auditory object presence. Specifically, we investigate the personal preferences on the auditory registration of a sounding object (a drone transmitting speech) in a room in anechoic versus artificial reverberation conditions. The results indicate a marginal preference of the reverberation, but much less than what we have anticipated. We discuss possible reasons for this, and set to compare our SDN implementation with a Waveguide Web (WGW) simulation in AR. While the WGWs are computationally more demanding, they have a potential to provide more accurate second-order reflections, and therefore, better registering of audio-visual AR scenes.

AB - ScatAR is an augmented reality (AR) audio application, where scattering delay networks (SDNs) efficiently generate and organize a reverberator based on room geometry scanned by an AR device. Here we present a perceptual evaluation of the application in terms of auditory object presence. Specifically, we investigate the personal preferences on the auditory registration of a sounding object (a drone transmitting speech) in a room in anechoic versus artificial reverberation conditions. The results indicate a marginal preference of the reverberation, but much less than what we have anticipated. We discuss possible reasons for this, and set to compare our SDN implementation with a Waveguide Web (WGW) simulation in AR. While the WGWs are computationally more demanding, they have a potential to provide more accurate second-order reflections, and therefore, better registering of audio-visual AR scenes.

KW - Auditory feedback

KW - Human-centered computing

KW - Mixed / augmented reality

UR - http://www.scopus.com/inward/record.url?scp=85060496671&partnerID=8YFLogxK

U2 - 10.1109/SIVE.2018.8577129

DO - 10.1109/SIVE.2018.8577129

M3 - Article in proceeding

AN - SCOPUS:85060496671

BT - 2018 IEEE 4th VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018

A2 - Nilsson, Niels Christian

A2 - Erkut, Cumhur

A2 - Serafin, Stefania

A2 - Avanzini, Federico

A2 - Geronazzo, Michele

A2 - Grani, Francesco

PB - IEEE

T2 - 4th IEEE VR Workshop on Sonic Interactions for Virtual Environments, SIVE 2018

Y2 - 18 March 2018

ER -

Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality

Abstract

Conference

Keywords

Access to Document

AUB Link

Other files and links

Fingerprint

Cite this