Developing a user-centred Communication Pad for Cognitive and Physical Impaired People

Chaudhary Muhammad Aqdus Ilyas; Kasper Rodil; Matthias Rehm

doi:10.1007/978-3-030-53294-9_9

Developing a user-centred Communication Pad for Cognitive and Physical Impaired People

Chaudhary Muhammad Aqdus Ilyas^*, Kasper Rodil, Matthias Rehm

^*Corresponding author

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

1 Citation (Scopus)

42 Downloads (Pure)

Abstract

It is always challenging for people with disabilities, particularly having speech inhibition to communicate. In this research article, we explored the case study of the resident at the neurological centre, having a complication in conveying messages due to physical and speech paralysis. For making effective communication, we have developed a user-centred communication pad where the resident needs to swipe a finger on the pad with printed alphabets and digits (we called it communication pad). A camera placed over the communication pad detects the finger movement of the resident and extract the message to display on the computer screen or the tablet. Our tracking method is robust and can track the fingers even in varying illumination conditions. This paper also covers the main steps of design methods with various design prototypes and its user feedback. Result analysis of different design modules and user experience evaluation shows that our designed system has provided independence and convenience to the resident in conveying a message successfully.

Original language	English
Title of host publication	In proceedings of 8th EAI International Conference: ArtsIT, Interactivity & Game Creation
Editors	Anthony Brooks, Eva Irene Brooks
Number of pages	14
Volume	328
Publisher	Springer Publishing Company
Publication date	2020
Pages	124-137
ISBN (Print)	9783030532932
DOIs	https://doi.org/10.1007/978-3-030-53294-9_9
Publication status	Published - 2020
Event	8th EAI International Conference: ArtsIT, Interactivity & Game Creation - Aalborg University, Aalborg, Denmark Duration: 6 Nov 2019 → 8 Nov 2019 Conference number: 8 http://artsit.org

Conference

Conference	8th EAI International Conference: ArtsIT, Interactivity & Game Creation
Number	8
Location	Aalborg University
Country	Denmark
City	Aalborg
Period	06/11/2019 → 08/11/2019
Internet address	http://artsit.org

Series	Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST)
Volume	328
ISSN	1867-8211

Bibliographical note

Link to accepted paper: http://artsit.org/accepted-papers/

Keywords

Ambient Assistive Technology (AAT)
Augmentive and Alternative Communication (AAC)
Design
Finger tracking system
User experience

Access to Document

10.1007/978-3-030-53294-9_9

Fingerprint Dive into the research topics of 'Developing a user-centred Communication Pad for Cognitive and Physical Impaired People'. Together they form a unique fingerprint.

1 Finished

Handling stress reactions in institutional care by adapting interaction behavior of a social robot
Ilyas, C. M., Nasrollahi, K., Rehm, M. & Moeslund, T. B.
03/04/2017 → 14/04/2020
Project: Research

Cite this

Ilyas, C. M. A., Rodil, K., & Rehm, M. (2020). Developing a user-centred Communication Pad for Cognitive and Physical Impaired People. In A. Brooks, & E. I. Brooks (Eds.), In proceedings of 8th EAI International Conference: ArtsIT, Interactivity & Game Creation (Vol. 328, pp. 124-137). Springer Publishing Company. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST) Vol. 328 https://doi.org/10.1007/978-3-030-53294-9_9

Ilyas, Chaudhary Muhammad Aqdus ; Rodil, Kasper ; Rehm, Matthias. / Developing a user-centred Communication Pad for Cognitive and Physical Impaired People. In proceedings of 8th EAI International Conference: ArtsIT, Interactivity & Game Creation. editor / Anthony Brooks ; Eva Irene Brooks. Vol. 328 Springer Publishing Company, 2020. pp. 124-137 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST), Vol. 328).

@inproceedings{187986eb732747e297b15630d5b39dbe,

title = "Developing a user-centred Communication Pad for Cognitive and Physical Impaired People",

abstract = "It is always challenging for people with disabilities, particularly having speech inhibition to communicate. In this research article, we explored the case study of the resident at the neurological centre, having a complication in conveying messages due to physical and speech paralysis. For making effective communication, we have developed a user-centred communication pad where the resident needs to swipe a finger on the pad with printed alphabets and digits (we called it communication pad). A camera placed over the communication pad detects the finger movement of the resident and extract the message to display on the computer screen or the tablet. Our tracking method is robust and can track the fingers even in varying illumination conditions. This paper also covers the main steps of design methods with various design prototypes and its user feedback. Result analysis of different design modules and user experience evaluation shows that our designed system has provided independence and convenience to the resident in conveying a message successfully.",

keywords = "Ambient Assistive Technology (AAT), Augmentive and Alternative Communication (AAC), Design, Finger tracking system, User experience",

author = "Ilyas, {Chaudhary Muhammad Aqdus} and Kasper Rodil and Matthias Rehm",

note = "Link to accepted paper: http://artsit.org/accepted-papers/ ; 8th EAI International Conference: ArtsIT, Interactivity & Game Creation, ArtsIT 2019 ; Conference date: 06-11-2019 Through 08-11-2019",

year = "2020",

doi = "10.1007/978-3-030-53294-9_9",

language = "English",

isbn = "9783030532932",

volume = "328",

series = "Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST)",

publisher = "Springer Publishing Company",

pages = "124--137",

editor = "Anthony Brooks and Brooks, {Eva Irene}",

booktitle = "In proceedings of 8th EAI International Conference: ArtsIT, Interactivity & Game Creation",

address = "United States",

url = "http://artsit.org",

}

Ilyas, CMA , Rodil, K & Rehm, M 2020, Developing a user-centred Communication Pad for Cognitive and Physical Impaired People. in A Brooks & EI Brooks (eds), In proceedings of 8th EAI International Conference: ArtsIT, Interactivity & Game Creation. vol. 328, Springer Publishing Company, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST), vol. 328, pp. 124-137, 8th EAI International Conference: ArtsIT, Interactivity & Game Creation, Aalborg, Denmark, 06/11/2019. https://doi.org/10.1007/978-3-030-53294-9_9

Developing a user-centred Communication Pad for Cognitive and Physical Impaired People. / Ilyas, Chaudhary Muhammad Aqdus ; Rodil, Kasper ; Rehm, Matthias.

In proceedings of 8th EAI International Conference: ArtsIT, Interactivity & Game Creation. ed. / Anthony Brooks; Eva Irene Brooks. Vol. 328 Springer Publishing Company, 2020. p. 124-137 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST), Vol. 328).

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

TY - GEN

T1 - Developing a user-centred Communication Pad for Cognitive and Physical Impaired People

AU - Ilyas, Chaudhary Muhammad Aqdus

AU - Rodil, Kasper

AU - Rehm, Matthias

N1 - Conference code: 8

PY - 2020

Y1 - 2020

N2 - It is always challenging for people with disabilities, particularly having speech inhibition to communicate. In this research article, we explored the case study of the resident at the neurological centre, having a complication in conveying messages due to physical and speech paralysis. For making effective communication, we have developed a user-centred communication pad where the resident needs to swipe a finger on the pad with printed alphabets and digits (we called it communication pad). A camera placed over the communication pad detects the finger movement of the resident and extract the message to display on the computer screen or the tablet. Our tracking method is robust and can track the fingers even in varying illumination conditions. This paper also covers the main steps of design methods with various design prototypes and its user feedback. Result analysis of different design modules and user experience evaluation shows that our designed system has provided independence and convenience to the resident in conveying a message successfully.

AB - It is always challenging for people with disabilities, particularly having speech inhibition to communicate. In this research article, we explored the case study of the resident at the neurological centre, having a complication in conveying messages due to physical and speech paralysis. For making effective communication, we have developed a user-centred communication pad where the resident needs to swipe a finger on the pad with printed alphabets and digits (we called it communication pad). A camera placed over the communication pad detects the finger movement of the resident and extract the message to display on the computer screen or the tablet. Our tracking method is robust and can track the fingers even in varying illumination conditions. This paper also covers the main steps of design methods with various design prototypes and its user feedback. Result analysis of different design modules and user experience evaluation shows that our designed system has provided independence and convenience to the resident in conveying a message successfully.

KW - Ambient Assistive Technology (AAT)

KW - Augmentive and Alternative Communication (AAC)

KW - Design

KW - Finger tracking system

KW - User experience

UR - http://www.scopus.com/inward/record.url?scp=85089315024&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-53294-9_9

DO - 10.1007/978-3-030-53294-9_9

M3 - Article in proceeding

SN - 9783030532932

VL - 328

T3 - Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST)

SP - 124

EP - 137

BT - In proceedings of 8th EAI International Conference: ArtsIT, Interactivity & Game Creation

A2 - Brooks, Anthony

A2 - Brooks, Eva Irene

PB - Springer Publishing Company

T2 - 8th EAI International Conference: ArtsIT, Interactivity & Game Creation

Y2 - 6 November 2019 through 8 November 2019

ER -

Ilyas CMA , Rodil K , Rehm M. Developing a user-centred Communication Pad for Cognitive and Physical Impaired People. In Brooks A, Brooks EI, editors, In proceedings of 8th EAI International Conference: ArtsIT, Interactivity & Game Creation. Vol. 328. Springer Publishing Company. 2020. p. 124-137. (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST), Vol. 328). https://doi.org/10.1007/978-3-030-53294-9_9

Developing a user-centred Communication Pad for Cognitive and Physical Impaired People

Abstract

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Handling stress reactions in institutional care by adapting interaction behavior of a social robot

Cite this