Resumé

Rehabilitation after traumatic brain injury (TBI) is very critical as it is largely unpredictable depending upon the nature of the injury. Rehabilitation process and recovery time also varies, as it takes months and years, depending upon the assessment of treatment, mental and physical conditions and strategies. Due to non-cooperative behaviour of patients, and increase in negative emotional expressions it is very beneficial to evaluate these expressions in a contactless way, and perform a rehabilitation physiotherapy, cognitive or other behavioral activities when the patient is in a positive mood. In this paper we have analyzed the methods for facial features extraction for TBI patients to determine optimal time to have aforementioned rehabilitation process on the basis of positive and negative facial expressions. We have employed a deep learning architecture based on convolutional neural network and long short term memory on RGB and thermal data that were collected in challenging scenarios from real patients. It automatically identifies the patient's facial expressions, and inform experts or trainers that "it is the time" to start rehabilitation session.
OriginalsprogEngelsk
Titel2018 IEEE International Conference on Image Processing : ICIP 2018
Antal sider5
ForlagIEEE
Publikationsdato7 okt. 2018
Sider2291-2295
Artikelnummer8451223
ISBN (Trykt)978-1-4799-7062-9
ISBN (Elektronisk)978-1-4799-7061-2
DOI
StatusUdgivet - 7 okt. 2018
Begivenhed2018 IEEE International Conference on Image Processing: Imaging beyond imagination - Megaron Athens International Conference Centre, Athens, Greece, Athens, Grækenland
Varighed: 7 okt. 201810 okt. 2018
https://2018.ieeeicip.org/default.asp

Konference

Konference2018 IEEE International Conference on Image Processing
LokationMegaron Athens International Conference Centre, Athens, Greece
LandGrækenland
ByAthens
Periode07/10/201810/10/2018
Internetadresse
NavnIEEE International Conference on Image Processing (ICIP)
ISSN2381-8549

Fingerprint

Rehabilitation
Brain
Facial Expression
Long-Term Memory
Short-Term Memory
Hot Temperature
Learning
Wounds and Injuries
Traumatic Brain Injury
Therapeutics

Citer dette

Ilyas, C. M. A., Nasrollahi, K., Rehm, M., & Moeslund, T. B. (2018). Rehabilitation of Traumatic Brain Injured Patients: Patient Mood Analysis from Multimodal Video. I 2018 IEEE International Conference on Image Processing: ICIP 2018 (s. 2291-2295). [8451223] IEEE. IEEE International Conference on Image Processing (ICIP) https://doi.org/10.1109/ICIP.2018.8451223
Ilyas, Chaudhary Muhammad Aqdus ; Nasrollahi, Kamal ; Rehm, Matthias ; Moeslund, Thomas B. / Rehabilitation of Traumatic Brain Injured Patients : Patient Mood Analysis from Multimodal Video. 2018 IEEE International Conference on Image Processing: ICIP 2018. IEEE, 2018. s. 2291-2295 (IEEE International Conference on Image Processing (ICIP)).
@inproceedings{684b970bc9cc4bcc88eccdaf0c690806,
title = "Rehabilitation of Traumatic Brain Injured Patients: Patient Mood Analysis from Multimodal Video",
abstract = "Rehabilitation after traumatic brain injury (TBI) is very critical as it is largely unpredictable depending upon the nature of the injury. Rehabilitation process and recovery time also varies, as it takes months and years, depending upon the assessment of treatment, mental and physical conditions and strategies. Due to non-cooperative behaviour of patients, and increase in negative emotional expressions it is very beneficial to evaluate these expressions in a contactless way, and perform a rehabilitation physiotherapy, cognitive or other behavioral activities when the patient is in a positive mood. In this paper we have analyzed the methods for facial features extraction for TBI patients to determine optimal time to have aforementioned rehabilitation process on the basis of positive and negative facial expressions. We have employed a deep learning architecture based on convolutional neural network and long short term memory on RGB and thermal data that were collected in challenging scenarios from real patients. It automatically identifies the patient's facial expressions, and inform experts or trainers that {"}it is the time{"} to start rehabilitation session.",
author = "Ilyas, {Chaudhary Muhammad Aqdus} and Kamal Nasrollahi and Matthias Rehm and Moeslund, {Thomas B.}",
year = "2018",
month = "10",
day = "7",
doi = "10.1109/ICIP.2018.8451223",
language = "English",
isbn = "978-1-4799-7062-9",
series = "IEEE International Conference on Image Processing (ICIP)",
pages = "2291--2295",
booktitle = "2018 IEEE International Conference on Image Processing",
publisher = "IEEE",
address = "United States",

}

Ilyas, CMA, Nasrollahi, K, Rehm, M & Moeslund, TB 2018, Rehabilitation of Traumatic Brain Injured Patients: Patient Mood Analysis from Multimodal Video. i 2018 IEEE International Conference on Image Processing: ICIP 2018., 8451223, IEEE, IEEE International Conference on Image Processing (ICIP), s. 2291-2295, 2018 IEEE International Conference on Image Processing, Athens, Grækenland, 07/10/2018. https://doi.org/10.1109/ICIP.2018.8451223

Rehabilitation of Traumatic Brain Injured Patients : Patient Mood Analysis from Multimodal Video. / Ilyas, Chaudhary Muhammad Aqdus; Nasrollahi, Kamal; Rehm, Matthias; Moeslund, Thomas B.

2018 IEEE International Conference on Image Processing: ICIP 2018. IEEE, 2018. s. 2291-2295 8451223 (IEEE International Conference on Image Processing (ICIP)).

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

TY - GEN

T1 - Rehabilitation of Traumatic Brain Injured Patients

T2 - Patient Mood Analysis from Multimodal Video

AU - Ilyas, Chaudhary Muhammad Aqdus

AU - Nasrollahi, Kamal

AU - Rehm, Matthias

AU - Moeslund, Thomas B.

PY - 2018/10/7

Y1 - 2018/10/7

N2 - Rehabilitation after traumatic brain injury (TBI) is very critical as it is largely unpredictable depending upon the nature of the injury. Rehabilitation process and recovery time also varies, as it takes months and years, depending upon the assessment of treatment, mental and physical conditions and strategies. Due to non-cooperative behaviour of patients, and increase in negative emotional expressions it is very beneficial to evaluate these expressions in a contactless way, and perform a rehabilitation physiotherapy, cognitive or other behavioral activities when the patient is in a positive mood. In this paper we have analyzed the methods for facial features extraction for TBI patients to determine optimal time to have aforementioned rehabilitation process on the basis of positive and negative facial expressions. We have employed a deep learning architecture based on convolutional neural network and long short term memory on RGB and thermal data that were collected in challenging scenarios from real patients. It automatically identifies the patient's facial expressions, and inform experts or trainers that "it is the time" to start rehabilitation session.

AB - Rehabilitation after traumatic brain injury (TBI) is very critical as it is largely unpredictable depending upon the nature of the injury. Rehabilitation process and recovery time also varies, as it takes months and years, depending upon the assessment of treatment, mental and physical conditions and strategies. Due to non-cooperative behaviour of patients, and increase in negative emotional expressions it is very beneficial to evaluate these expressions in a contactless way, and perform a rehabilitation physiotherapy, cognitive or other behavioral activities when the patient is in a positive mood. In this paper we have analyzed the methods for facial features extraction for TBI patients to determine optimal time to have aforementioned rehabilitation process on the basis of positive and negative facial expressions. We have employed a deep learning architecture based on convolutional neural network and long short term memory on RGB and thermal data that were collected in challenging scenarios from real patients. It automatically identifies the patient's facial expressions, and inform experts or trainers that "it is the time" to start rehabilitation session.

U2 - 10.1109/ICIP.2018.8451223

DO - 10.1109/ICIP.2018.8451223

M3 - Article in proceeding

SN - 978-1-4799-7062-9

T3 - IEEE International Conference on Image Processing (ICIP)

SP - 2291

EP - 2295

BT - 2018 IEEE International Conference on Image Processing

PB - IEEE

ER -

Ilyas CMA, Nasrollahi K, Rehm M, Moeslund TB. Rehabilitation of Traumatic Brain Injured Patients: Patient Mood Analysis from Multimodal Video. I 2018 IEEE International Conference on Image Processing: ICIP 2018. IEEE. 2018. s. 2291-2295. 8451223. (IEEE International Conference on Image Processing (ICIP)). https://doi.org/10.1109/ICIP.2018.8451223