Effective Facial Expression Recognition Through Multimodal Imaging for Traumatic Brain Injured Patient’s Rehabilitation

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

Abstrakt

This article presents the issues related to applying computer vision techniques to identify facial expressions and recognize the mood of Traumatic Brain Injured (TBI) patients in real life scenarios. Many TBI patients face serious problems in communication and activities of daily living. These are due to restricted movement of muscles or paralysis with lesser facial expression along with non-cooperative behaviour, and inappropriate reasoning and reactions. All these aforementioned attributes contribute towards the complexity of the system for the automatic understanding of their emotional expressions. Existing systems for facial expression recognition are highly accurate when tested on healthy people in controlled conditions. However, their performance is not yet verified on the TBI patients in the real environment. In order to test this, we devised a special arrangement to collect data from these patients. Unlike the controlled environment, it was very challenging because these patients have large pose variations, poor attention and concentration with impulsive behaviours. In order to acquire high-quality facial images from videos for facial expression analysis, effective techniques of data preprocessing are applied. The extracted images are then fed to a deep learning architecture based on Convolution Neural Network (CNN) and Long Short-Term Memory (LSTM) network to exploit the spatiotemporal information with 3D face frontalization. RGB and thermal imaging modalities are used and the experimental results show that better quality of facial images and larger database enhance the system performance in facial expressions and mood recognition of TBI patients under natural challenging conditions. The proposed approach hopefully facilitates the physiotherapists, trainers and caregivers to deploy fast rehabilitation activities by knowing the positive mood of the patients.

OriginalsprogEngelsk
TitelComputer Vision, Imaging and Computer Graphics Theory and Applications : 13th International Joint Conference, VISIGRAPP 2018 Funchal–Madeira, Portugal, January 27–29, 2018, Revised Selected Papers
RedaktørerDominique Bechmann, Manuela Chessa, Ana Paula Cláudio, Francisco Imai, Andreas Kerren, Paul Richard, Alexandru Telea, Alain Tremeau
Antal sider21
ForlagSpringer Publishing Company
Publikationsdato2 jul. 2019
Sider369-389
ISBN (Trykt)978-3-030-26755-1
ISBN (Elektronisk)978-3-030-26756-8
DOI
StatusUdgivet - 2 jul. 2019
Begivenhed14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (Visigrapp 2019) - Prague, Tjekkiet
Varighed: 25 feb. 201927 feb. 2019

Konference

Konference14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (Visigrapp 2019)
LandTjekkiet
ByPrague
Periode25/02/201927/02/2019
NavnCommunications in Computer and Information Science
Vol/bindCCIS, volume 997
ISSN1865-0929

Fingeraftryk Dyk ned i forskningsemnerne om 'Effective Facial Expression Recognition Through Multimodal Imaging for Traumatic Brain Injured Patient’s Rehabilitation'. Sammen danner de et unikt fingeraftryk.

Citationsformater