Projekter pr. år
Abstract
A multisensory virtual environment has been designed, aiming at recreating a realistic interaction with a set of vibrating strings. Haptic, auditory and visual cues progressively istantiate the environment: force and tactile feedback are provided by a robotic arm reporting for string reaction, string surface properties, and furthermore defining the physical touchpoint in form of a virtual plectrum embodied by the arm stylus. Auditory feedback is instantaneously synthesized as a result of the contacts of this plectrum against the strings, reproducing guitar sounds. A simple visual scenario contextualizes the plectrum in action along with the vibrating strings. Notes and chords are selected using a keyboard controller, in ways that one hand is engaged in the creation of a melody while the other hand plucks virtual strings. Such components have been integrated within the Unity3D simulation environment for game development, and run altogether on a PC. As also declared by a group of users testing a monophonic Keytar prototype with no keyboard control, the most significant contribution to the realism of the strings is given by the haptic feedback, in particular by the textural nuances that the robotic arm synthesizes while reproducing physical attributes of a metal surface. Their opinion, hence, argues in favor of the importance of factors others than auditory feedback for the design of new musical interfaces.
Originalsprog | Engelsk |
---|---|
Titel | Proceedings of the 22nd International Conference on Digital Audio Effects, DAFx 2019 |
Antal sider | 6 |
Forlag | DMT Lab, Birmingham City University |
Publikationsdato | 2019 |
Sider | 47-52 |
Status | Udgivet - 2019 |
Begivenhed | 22nd International Conference on Digital Audio Effects, DAFx 2019 - Birmingham, Storbritannien Varighed: 2 sep. 2019 → 6 sep. 2019 |
Konference
Konference | 22nd International Conference on Digital Audio Effects, DAFx 2019 |
---|---|
Land/Område | Storbritannien |
By | Birmingham |
Periode | 02/09/2019 → 06/09/2019 |
Bibliografisk note
Publisher Copyright:© 2019 Federico Fontana et al.
Fingeraftryk
Dyk ned i forskningsemnerne om 'Keytar: Melodic control of multisensory feedback from virtual strings'. Sammen danner de et unikt fingeraftryk.Projekter
- 1 Igangværende
-
NordicSMC: Nordic Sound and Music Computing Network
Serafin, S., Dahl, S., Willemsen, S., Kantan, P. R. & Paisa, R.
01/01/2018 → …
Projekter: Projekt › Forskning