Multisensory plucked instrumentmodeling in unity3D: From Keytar to accurate string prototyping

Federico Fontana*, Razvan Paisa, Roberto Ranon, Stefania Serafin

*Corresponding author

Research output: Contribution to journalJournal articleResearchpeer-review

2 Citations (Scopus)
4 Downloads (Pure)

Abstract

Keytar is a plucked guitar simulation mockup developed with Unity3D that provides auditory, visual, and haptic feedback to the player through a Phantom Omni robotic arm. Starting from a description of the implementation of the virtual instrument, we discuss our ongoing work. The ultimate goal is the creation of a set of software tools available for developing plucked instruments in Unity3D. Using such tools, sonic interaction designers can efficiently simulate plucked string prototypes and realize multisensory interactions with virtual instruments for unprecedented purposes, such as testing innovative plucked string interfaces or training machine learning algorithms with data about the dynamics of the performance, which are immediately accessible from the machine.
Original languageEnglish
Article number1452
JournalApplied Sciences (Switzerland)
Volume10
Issue number4
ISSN2076-3417
DOIs
Publication statusPublished - 1 Feb 2020

Keywords

  • Multisensory feedback
  • Musical haptics
  • Stringed musical instruments
  • Virtual reality

Fingerprint Dive into the research topics of 'Multisensory plucked instrumentmodeling in unity3D: From Keytar to accurate string prototyping'. Together they form a unique fingerprint.

Cite this