Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users’ Musical Training

Francesco Ganis; Marianna Vatti; Stefania Serafin

doi:10.1007/978-3-031-15019-7_2

Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users’ Musical Training

Francesco Ganis^*, Marianna Vatti, Stefania Serafin

^*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

1 Citation (Scopus)

Abstract

Cochlear implants (CIs) allow individuals that can no longer benefit from hearing aids to understand speech with remarkable efficiency. On the other hand, they perform poorly in music perception. Previous research suggest that music experience can be enhanced with the use of other senses such as touch. We present Tickle Tuner, a haptic feedback device suitable for musical training of CI users. The prototype is composed of two high-quality haptic actuators and an external Digital to Analogue Converter (DAC) hosted in a 3D printed enclosure coupled with a smartphone. We describe the design and implementation of the prototype and the analysis of its characteristics. We introduce a test bench for the design of different mappings between sound and vibrations which we assessed with a Melodic Contour Identification (MCI) task. Results from a group of fifteen normal hearing participants using CIs simulation showed significantly higher performance (increase of 26% more correct answers) with haptic feedback than without.

Original language	English
Title of host publication	Haptic and Audio Interaction Design : 11th International Workshop, HAID 2022, London, UK, August 25–26, 2022, Proceedings
Editors	Charalampos Saitis, Ildar Farkhatdinov, Stefano Papetti
Number of pages	11
Publisher	Springer
Publication date	2022
Pages	14-24
ISBN (Print)	978-3-031-15018-0
ISBN (Electronic)	978-3-031-15019-7
DOIs	https://doi.org/10.1007/978-3-031-15019-7_2
Publication status	Published - 2022
Event	11th International Workshop on Haptic and Audio Interaction Design, HAID 2022 - London, United Kingdom Duration: 25 Aug 2022 → 26 Aug 2022

Conference

Conference	11th International Workshop on Haptic and Audio Interaction Design, HAID 2022
Country/Territory	United Kingdom
City	London
Period	25/08/2022 → 26/08/2022

Series	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13417 LNCS
ISSN	0302-9743

Bibliographical note

Publisher Copyright:
© 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Keywords

Cochlear implants
Haptic feedback
Musical training

Access to Document

10.1007/978-3-031-15019-7_2

https://zenodo.org/record/6800792/files/d11.pdfLicence: CC BY 3.0

AUB Link

Search for the material in Aalborg University Library's search engine

Cite this

Ganis, F., Vatti, M., & Serafin, S. (2022). Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users’ Musical Training. In C. Saitis, I. Farkhatdinov, & S. Papetti (Eds.), Haptic and Audio Interaction Design: 11th International Workshop, HAID 2022, London, UK, August 25–26, 2022, Proceedings (pp. 14-24). Springer. https://doi.org/10.1007/978-3-031-15019-7_2

Ganis, Francesco ; Vatti, Marianna ; Serafin, Stefania. / Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users’ Musical Training. Haptic and Audio Interaction Design: 11th International Workshop, HAID 2022, London, UK, August 25–26, 2022, Proceedings. editor / Charalampos Saitis ; Ildar Farkhatdinov ; Stefano Papetti. Springer, 2022. pp. 14-24 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 13417 LNCS).

@inproceedings{0aff8be129d648b78984429e6a21c27c,

title = "Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users{\textquoteright} Musical Training",

abstract = "Cochlear implants (CIs) allow individuals that can no longer benefit from hearing aids to understand speech with remarkable efficiency. On the other hand, they perform poorly in music perception. Previous research suggest that music experience can be enhanced with the use of other senses such as touch. We present Tickle Tuner, a haptic feedback device suitable for musical training of CI users. The prototype is composed of two high-quality haptic actuators and an external Digital to Analogue Converter (DAC) hosted in a 3D printed enclosure coupled with a smartphone. We describe the design and implementation of the prototype and the analysis of its characteristics. We introduce a test bench for the design of different mappings between sound and vibrations which we assessed with a Melodic Contour Identification (MCI) task. Results from a group of fifteen normal hearing participants using CIs simulation showed significantly higher performance (increase of 26% more correct answers) with haptic feedback than without.",

keywords = "Cochlear implants, Haptic feedback, Musical training",

author = "Francesco Ganis and Marianna Vatti and Stefania Serafin",

note = "Publisher Copyright: {\textcopyright} 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 11th International Workshop on Haptic and Audio Interaction Design, HAID 2022 ; Conference date: 25-08-2022 Through 26-08-2022",

year = "2022",

doi = "10.1007/978-3-031-15019-7_2",

language = "English",

isbn = "978-3-031-15018-0",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "14--24",

editor = "Charalampos Saitis and Ildar Farkhatdinov and Stefano Papetti",

booktitle = "Haptic and Audio Interaction Design",

address = "Germany",

}

Ganis, F, Vatti, M & Serafin, S 2022, Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users’ Musical Training. in C Saitis, I Farkhatdinov & S Papetti (eds), Haptic and Audio Interaction Design: 11th International Workshop, HAID 2022, London, UK, August 25–26, 2022, Proceedings. Springer, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13417 LNCS, pp. 14-24, 11th International Workshop on Haptic and Audio Interaction Design, HAID 2022, London, United Kingdom, 25/08/2022. https://doi.org/10.1007/978-3-031-15019-7_2

Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users’ Musical Training. / Ganis, Francesco; Vatti, Marianna; Serafin, Stefania.
Haptic and Audio Interaction Design: 11th International Workshop, HAID 2022, London, UK, August 25–26, 2022, Proceedings. ed. / Charalampos Saitis; Ildar Farkhatdinov; Stefano Papetti. Springer, 2022. p. 14-24 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 13417 LNCS).

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

TY - GEN

T1 - Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users’ Musical Training

AU - Ganis, Francesco

AU - Vatti, Marianna

AU - Serafin, Stefania

PY - 2022

Y1 - 2022

N2 - Cochlear implants (CIs) allow individuals that can no longer benefit from hearing aids to understand speech with remarkable efficiency. On the other hand, they perform poorly in music perception. Previous research suggest that music experience can be enhanced with the use of other senses such as touch. We present Tickle Tuner, a haptic feedback device suitable for musical training of CI users. The prototype is composed of two high-quality haptic actuators and an external Digital to Analogue Converter (DAC) hosted in a 3D printed enclosure coupled with a smartphone. We describe the design and implementation of the prototype and the analysis of its characteristics. We introduce a test bench for the design of different mappings between sound and vibrations which we assessed with a Melodic Contour Identification (MCI) task. Results from a group of fifteen normal hearing participants using CIs simulation showed significantly higher performance (increase of 26% more correct answers) with haptic feedback than without.

AB - Cochlear implants (CIs) allow individuals that can no longer benefit from hearing aids to understand speech with remarkable efficiency. On the other hand, they perform poorly in music perception. Previous research suggest that music experience can be enhanced with the use of other senses such as touch. We present Tickle Tuner, a haptic feedback device suitable for musical training of CI users. The prototype is composed of two high-quality haptic actuators and an external Digital to Analogue Converter (DAC) hosted in a 3D printed enclosure coupled with a smartphone. We describe the design and implementation of the prototype and the analysis of its characteristics. We introduce a test bench for the design of different mappings between sound and vibrations which we assessed with a Melodic Contour Identification (MCI) task. Results from a group of fifteen normal hearing participants using CIs simulation showed significantly higher performance (increase of 26% more correct answers) with haptic feedback than without.

KW - Cochlear implants

KW - Haptic feedback

KW - Musical training

UR - http://www.scopus.com/inward/record.url?scp=85136940691&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-15019-7_2

DO - 10.1007/978-3-031-15019-7_2

M3 - Article in proceeding

AN - SCOPUS:85136940691

SN - 978-3-031-15018-0

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 14

EP - 24

BT - Haptic and Audio Interaction Design

A2 - Saitis, Charalampos

A2 - Farkhatdinov, Ildar

A2 - Papetti, Stefano

PB - Springer

T2 - 11th International Workshop on Haptic and Audio Interaction Design, HAID 2022

Y2 - 25 August 2022 through 26 August 2022

ER -

Ganis F, Vatti M, Serafin S. Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users’ Musical Training. In Saitis C, Farkhatdinov I, Papetti S, editors, Haptic and Audio Interaction Design: 11th International Workshop, HAID 2022, London, UK, August 25–26, 2022, Proceedings. Springer. 2022. p. 14-24. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 13417 LNCS). doi: 10.1007/978-3-031-15019-7_2