ADEPT: Exploring the Design, Pedagogy, and Analysis of a Mixed Reality Application for Piano Training

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

48 Downloads (Pure)


One of the biggest challenges in learning how to play a musical instrument is learning how to move one's body with a nuanced physicality. Technology can expand available forms of physical interactions to help cue specific movements and postures. This cueing can reinforce new sensorimotor couplings to enhance motor learning and performance. Using Mixed Reality (MR), we present a system that allows students to share a first-person audiovisual perspective with a piano teacher. Students place their hands into the virtual gloves of a teacher. Motor learning and audio-motor associations are reinforced through motion feedback and spatialized audio. The Augmented Design to Embody a Piano Teacher (ADEPT) application is an early design prototype of this piano training system.
Original languageEnglish
Title of host publicationProceedings of the 16th Sound & Music Computing Conference SMC 2019
Number of pages9
PublisherSound and Music Computing Network
Publication date2019
ISBN (Electronic)978-84-09-08518-7
Publication statusPublished - 2019
Event16th Sound and music computing conference - University of Malaga (UMA). , Malaga, Spain
Duration: 28 May 201931 May 2019


Conference16th Sound and music computing conference
LocationUniversity of Malaga (UMA).
Internet address
SeriesProceedings of the Sound and Music Computing Conference


  • augmented reality
  • mixed reality
  • embodied cognition
  • technology-enhanced learning
  • piano training applications
  • motion capture
  • audio spatialization

Fingerprint Dive into the research topics of 'ADEPT: Exploring the Design, Pedagogy, and Analysis of a Mixed Reality Application for Piano Training'. Together they form a unique fingerprint.

Cite this