Combining Texture-Derived Vibrotactile Feedback, Concatenative Synthesis and Photogrammetry for Virtual Reality Rendering

Eduardo Magalhaes, Emil Rosenlund Høeg, Gilberto Bernardes, Jon Ram Bruun-Pedersen, Stefania Serafin, Rolf Nordahl

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

2 Citationer (Scopus)
99 Downloads (Pure)

Abstract

This paper describes a novel framework for real-time sonification of surface textures in virtual reality (VR), aimed towards realistically representing the experience of driving over a virtual surface. A combination of captur- ing techniques of real-world surfaces are used for mapping 3D geometry, texture maps or auditory attributes (aural and vibrotactile) feedback. For the sonification rendering, we propose the use of information from primarily graphical texture features, to define target units in concatenative sound synthesis. To foster models that go beyond current generation of simple sound textures (e.g., wind, rain, fire), towards highly “synchronized” and expressive scenarios, our contribution draws a framework for higher-level modeling of a bicycle’s kinematic rolling on ground contact, with enhanced perceptual symbiosis between auditory, visual and vibrotactile stimuli. We scanned two surfaces represented as texture maps, consisting of different features, morphology and matching navigation. We define target trajectories in a 2-dimensional audio feature space, according to a temporal model and morphological attributes of the surfaces. This synthesis method serves two purposes: a real-time auditory feedback, and vibrotactile feedback induced through playing back the concatenated sound samples using a vibrotactile inducer speaker.
OriginalsprogEngelsk
TitelProceedings of 2019 Sound and Music Computing Conference
RedaktørerIsabel Barbancho, Lorenzo J. Tardón, Alberto Peinado, Ana M. Barbancho
Antal sider8
ForlagSound and Music Computing Network
Publikationsdatomaj 2019
Sider348-355
ISBN (Trykt)978-84-09-08518-7
ISBN (Elektronisk)978-84-09-11120-6
StatusUdgivet - maj 2019
Begivenhed16th Sound and music computing conference - University of Malaga (UMA). , Malaga, Spanien
Varighed: 28 maj 201931 maj 2019
http://smc2019.uma.es/index.html

Konference

Konference16th Sound and music computing conference
LokationUniversity of Malaga (UMA).
Land/OmrådeSpanien
ByMalaga
Periode28/05/201931/05/2019
Internetadresse
NavnProceedings of the Sound and Music Computing Conference
ISSN2518-3672

Fingeraftryk

Dyk ned i forskningsemnerne om 'Combining Texture-Derived Vibrotactile Feedback, Concatenative Synthesis and Photogrammetry for Virtual Reality Rendering'. Sammen danner de et unikt fingeraftryk.

Citationsformater