ADEPT: Exploring the Design, Pedagogy, and Analysis of a Mixed Reality Application for Piano Training

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

12 Downloads (Pure)

Resumé

One of the biggest challenges in learning how to play a musical instrument is learning how to move one's body with a nuanced physicality. Technology can expand available forms of physical interactions to help cue specific movements and postures. This cueing can reinforce new sensorimotor couplings to enhance motor learning and performance. Using Mixed Reality (MR), we present a system that allows students to share a first-person audiovisual perspective with a piano teacher. Students place their hands into the virtual gloves of a teacher. Motor learning and audio-motor associations are reinforced through motion feedback and spatialized audio. The Augmented Design to Embody a Piano Teacher (ADEPT) application is an early design prototype of this piano training system.
OriginalsprogEngelsk
TitelProceedings of the 16th Sound & Music Computing Conference SMC 2019
Antal sider9
Publikationsdato2019
ISBN (Elektronisk)978-84-09-08518-7
StatusUdgivet - 2019

Fingerprint

Students
Musical instruments
Feedback

Citer dette

@inproceedings{cdc1eff704284585bc6e6d3e6481846e,
title = "ADEPT: Exploring the Design, Pedagogy, and Analysis of a Mixed Reality Application for Piano Training",
abstract = "One of the biggest challenges in learning how to play a musical instrument is learning how to move one's body with a nuanced physicality. Technology can expand available forms of physical interactions to help cue specific movements and postures. This cueing can reinforce new sensorimotor couplings to enhance motor learning and performance. Using Mixed Reality (MR), we present a system that allows students to share a first-person audiovisual perspective with a piano teacher. Students place their hands into the virtual gloves of a teacher. Motor learning and audio-motor associations are reinforced through motion feedback and spatialized audio. The Augmented Design to Embody a Piano Teacher (ADEPT) application is an early design prototype of this piano training system.",
keywords = "augmented reality, mixed reality, embodied cognition, technology-enhanced learning, piano training applications, motion capture, audio spatialization",
author = "Lynda Gerry and Sofia Dahl and Stefania Serafin",
year = "2019",
language = "English",
booktitle = "Proceedings of the 16th Sound & Music Computing Conference SMC 2019",

}

ADEPT: Exploring the Design, Pedagogy, and Analysis of a Mixed Reality Application for Piano Training. / Gerry, Lynda; Dahl, Sofia; Serafin, Stefania.

Proceedings of the 16th Sound & Music Computing Conference SMC 2019. 2019.

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

TY - GEN

T1 - ADEPT: Exploring the Design, Pedagogy, and Analysis of a Mixed Reality Application for Piano Training

AU - Gerry, Lynda

AU - Dahl, Sofia

AU - Serafin, Stefania

PY - 2019

Y1 - 2019

N2 - One of the biggest challenges in learning how to play a musical instrument is learning how to move one's body with a nuanced physicality. Technology can expand available forms of physical interactions to help cue specific movements and postures. This cueing can reinforce new sensorimotor couplings to enhance motor learning and performance. Using Mixed Reality (MR), we present a system that allows students to share a first-person audiovisual perspective with a piano teacher. Students place their hands into the virtual gloves of a teacher. Motor learning and audio-motor associations are reinforced through motion feedback and spatialized audio. The Augmented Design to Embody a Piano Teacher (ADEPT) application is an early design prototype of this piano training system.

AB - One of the biggest challenges in learning how to play a musical instrument is learning how to move one's body with a nuanced physicality. Technology can expand available forms of physical interactions to help cue specific movements and postures. This cueing can reinforce new sensorimotor couplings to enhance motor learning and performance. Using Mixed Reality (MR), we present a system that allows students to share a first-person audiovisual perspective with a piano teacher. Students place their hands into the virtual gloves of a teacher. Motor learning and audio-motor associations are reinforced through motion feedback and spatialized audio. The Augmented Design to Embody a Piano Teacher (ADEPT) application is an early design prototype of this piano training system.

KW - augmented reality

KW - mixed reality

KW - embodied cognition

KW - technology-enhanced learning

KW - piano training applications

KW - motion capture

KW - audio spatialization

M3 - Article in proceeding

BT - Proceedings of the 16th Sound & Music Computing Conference SMC 2019

ER -