Music Aid: Towards a Collaborative Experience for Deaf and Hearing People in Creating Music

Ene Alicia Søderberg, Rasmus Emil Odgaard, Sarah Bitsch, Oliver Høeg-Jensen, Nikolaj Schildt Christensen, Søren Dahl Poulsen, Steven Gelineck

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

228 Downloads (Pure)

Abstract

This paper explores the possibility of breaking the barrier between deaf and hearing people when it comes to the subject of making music. Suggestions on how deaf and hearing people can collaborate in creating music together, are presented. The conducted research will focus on deaf people with a general interest in music as well as hearing musicians as target groups. Through reviewing different related research areas, it is found that visualization of sound along with a haptic feedback can help deaf people interpret and interact with music. With this in mind, three variations of a collaborative user interface are presented, in which deaf and hearing people are meant to collaborate in creating short beats and melody sequences. Through evaluating the three prototypes, with two deaf people and two hearing musicians, it is found that the target groups can collaborate to some extent in creating beats. However, in order for the target groups to create melodic sequences together in a satisfactory manner, more detailed visualization and distributed haptic output is necessary, mostly due to the fact that the deaf test participants struggle in distinguishing between higher pitch and timbre.
Original languageEnglish
Title of host publicationProceedings of the International Conference on New Interfaces for Musical Expression (NIME 2016)
Number of pages6
Publication date11 Jul 2016
Publication statusPublished - 11 Jul 2016
EventNew Interfaces for Musical Expression - Griffith University, Brisbane, Australia
Duration: 11 Jul 201615 Jul 2016
http://nime2016.org

Conference

ConferenceNew Interfaces for Musical Expression
LocationGriffith University
CountryAustralia
CityBrisbane
Period11/07/201615/07/2016
Internet address

Fingerprint

Audition
Visualization
User interfaces
Acoustic waves
Feedback

Keywords

  • hearing
  • deaf
  • partially deaf
  • music
  • creation
  • interaction
  • interface
  • haptic feedback
  • auditory feedback
  • for all
  • collaboration
  • Graphical User Interface

Cite this

Søderberg, E. A., Odgaard, R. E., Bitsch, S., Høeg-Jensen, O., Christensen, N. S., Poulsen, S. D., & Gelineck, S. (2016). Music Aid: Towards a Collaborative Experience for Deaf and Hearing People in Creating Music. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2016)
Søderberg, Ene Alicia ; Odgaard, Rasmus Emil ; Bitsch, Sarah ; Høeg-Jensen, Oliver ; Christensen, Nikolaj Schildt ; Poulsen, Søren Dahl ; Gelineck, Steven. / Music Aid : Towards a Collaborative Experience for Deaf and Hearing People in Creating Music. Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2016). 2016.
@inproceedings{b272d85d7480475995a4d38025abe2fa,
title = "Music Aid: Towards a Collaborative Experience for Deaf and Hearing People in Creating Music",
abstract = "This paper explores the possibility of breaking the barrier between deaf and hearing people when it comes to the subject of making music. Suggestions on how deaf and hearing people can collaborate in creating music together, are presented. The conducted research will focus on deaf people with a general interest in music as well as hearing musicians as target groups. Through reviewing different related research areas, it is found that visualization of sound along with a haptic feedback can help deaf people interpret and interact with music. With this in mind, three variations of a collaborative user interface are presented, in which deaf and hearing people are meant to collaborate in creating short beats and melody sequences. Through evaluating the three prototypes, with two deaf people and two hearing musicians, it is found that the target groups can collaborate to some extent in creating beats. However, in order for the target groups to create melodic sequences together in a satisfactory manner, more detailed visualization and distributed haptic output is necessary, mostly due to the fact that the deaf test participants struggle in distinguishing between higher pitch and timbre.",
keywords = "hearing, deaf, partially deaf, music , creation, interaction, interface, haptic feedback, auditory feedback, for all, collaboration, Graphical User Interface",
author = "S{\o}derberg, {Ene Alicia} and Odgaard, {Rasmus Emil} and Sarah Bitsch and Oliver H{\o}eg-Jensen and Christensen, {Nikolaj Schildt} and Poulsen, {S{\o}ren Dahl} and Steven Gelineck",
year = "2016",
month = "7",
day = "11",
language = "English",
booktitle = "Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2016)",

}

Søderberg, EA, Odgaard, RE, Bitsch, S, Høeg-Jensen, O, Christensen, NS, Poulsen, SD & Gelineck, S 2016, Music Aid: Towards a Collaborative Experience for Deaf and Hearing People in Creating Music. in Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2016). New Interfaces for Musical Expression, Brisbane, Australia, 11/07/2016.

Music Aid : Towards a Collaborative Experience for Deaf and Hearing People in Creating Music. / Søderberg, Ene Alicia; Odgaard, Rasmus Emil; Bitsch, Sarah ; Høeg-Jensen, Oliver ; Christensen, Nikolaj Schildt; Poulsen, Søren Dahl; Gelineck, Steven.

Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2016). 2016.

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

TY - GEN

T1 - Music Aid

T2 - Towards a Collaborative Experience for Deaf and Hearing People in Creating Music

AU - Søderberg, Ene Alicia

AU - Odgaard, Rasmus Emil

AU - Bitsch, Sarah

AU - Høeg-Jensen, Oliver

AU - Christensen, Nikolaj Schildt

AU - Poulsen, Søren Dahl

AU - Gelineck, Steven

PY - 2016/7/11

Y1 - 2016/7/11

N2 - This paper explores the possibility of breaking the barrier between deaf and hearing people when it comes to the subject of making music. Suggestions on how deaf and hearing people can collaborate in creating music together, are presented. The conducted research will focus on deaf people with a general interest in music as well as hearing musicians as target groups. Through reviewing different related research areas, it is found that visualization of sound along with a haptic feedback can help deaf people interpret and interact with music. With this in mind, three variations of a collaborative user interface are presented, in which deaf and hearing people are meant to collaborate in creating short beats and melody sequences. Through evaluating the three prototypes, with two deaf people and two hearing musicians, it is found that the target groups can collaborate to some extent in creating beats. However, in order for the target groups to create melodic sequences together in a satisfactory manner, more detailed visualization and distributed haptic output is necessary, mostly due to the fact that the deaf test participants struggle in distinguishing between higher pitch and timbre.

AB - This paper explores the possibility of breaking the barrier between deaf and hearing people when it comes to the subject of making music. Suggestions on how deaf and hearing people can collaborate in creating music together, are presented. The conducted research will focus on deaf people with a general interest in music as well as hearing musicians as target groups. Through reviewing different related research areas, it is found that visualization of sound along with a haptic feedback can help deaf people interpret and interact with music. With this in mind, three variations of a collaborative user interface are presented, in which deaf and hearing people are meant to collaborate in creating short beats and melody sequences. Through evaluating the three prototypes, with two deaf people and two hearing musicians, it is found that the target groups can collaborate to some extent in creating beats. However, in order for the target groups to create melodic sequences together in a satisfactory manner, more detailed visualization and distributed haptic output is necessary, mostly due to the fact that the deaf test participants struggle in distinguishing between higher pitch and timbre.

KW - hearing

KW - deaf

KW - partially deaf

KW - music

KW - creation

KW - interaction

KW - interface

KW - haptic feedback

KW - auditory feedback

KW - for all

KW - collaboration

KW - Graphical User Interface

M3 - Article in proceeding

BT - Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2016)

ER -

Søderberg EA, Odgaard RE, Bitsch S, Høeg-Jensen O, Christensen NS, Poulsen SD et al. Music Aid: Towards a Collaborative Experience for Deaf and Hearing People in Creating Music. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2016). 2016