Abstract
This paper describes a novel framework for real-time sonification of surface textures in virtual reality (VR), aimed towards realistically representing the experience of driving over a virtual surface. A combination of captur- ing techniques of real-world surfaces are used for mapping 3D geometry, texture maps or auditory attributes (aural and vibrotactile) feedback. For the sonification rendering, we propose the use of information from primarily graphical texture features, to define target units in concatenative sound synthesis. To foster models that go beyond current generation of simple sound textures (e.g., wind, rain, fire), towards highly “synchronized” and expressive scenarios, our contribution draws a framework for higher-level modeling of a bicycle’s kinematic rolling on ground contact, with enhanced perceptual symbiosis between auditory, visual and vibrotactile stimuli. We scanned two surfaces represented as texture maps, consisting of different features, morphology and matching navigation. We define target trajectories in a 2-dimensional audio feature space, according to a temporal model and morphological attributes of the surfaces. This synthesis method serves two purposes: a real-time auditory feedback, and vibrotactile feedback induced through playing back the concatenated sound samples using a vibrotactile inducer speaker.
Originalsprog | Engelsk |
---|---|
Titel | Proceedings of 2019 Sound and Music Computing Conference |
Redaktører | Isabel Barbancho, Lorenzo J. Tardón, Alberto Peinado, Ana M. Barbancho |
Antal sider | 8 |
Forlag | Sound and Music Computing Network |
Publikationsdato | maj 2019 |
Sider | 348-355 |
ISBN (Trykt) | 978-84-09-08518-7 |
ISBN (Elektronisk) | 978-84-09-11120-6 |
Status | Udgivet - maj 2019 |
Begivenhed | 16th Sound and music computing conference - University of Malaga (UMA). , Malaga, Spanien Varighed: 28 maj 2019 → 31 maj 2019 http://smc2019.uma.es/index.html |
Konference
Konference | 16th Sound and music computing conference |
---|---|
Lokation | University of Malaga (UMA). |
Land/Område | Spanien |
By | Malaga |
Periode | 28/05/2019 → 31/05/2019 |
Internetadresse |
Navn | Proceedings of the Sound and Music Computing Conference |
---|---|
ISSN | 2518-3672 |