Abstract

Rehabilitation after traumatic brain injury (TBI) is very critical as it is largely unpredictable depending upon the nature of the injury. Rehabilitation process and recovery time also varies, as it takes months and years, depending upon the assessment of treatment, mental and physical conditions and strategies. Due to non-cooperative behaviour of patients, and increase in negative emotional expressions it is very beneficial to evaluate these expressions in a contactless way, and perform a rehabilitation physiotherapy, cognitive or other behavioral activities when the patient is in a positive mood. In this paper we have analyzed the methods for facial features extraction for TBI patients to determine optimal time to have aforementioned rehabilitation process on the basis of positive and negative facial expressions. We have employed a deep learning architecture based on convolutional neural network and long short term memory on RGB and thermal data that were collected in challenging scenarios from real patients. It automatically identifies the patient's facial expressions, and inform experts or trainers that "it is the time" to start rehabilitation session.
Original languageEnglish
Title of host publication2018 IEEE International Conference on Image Processing : ICIP 2018
Number of pages5
PublisherIEEE
Publication date7 Oct 2018
Pages2291-2295
Article number8451223
ISBN (Print)978-1-4799-7062-9
ISBN (Electronic)978-1-4799-7061-2
DOIs
Publication statusPublished - 7 Oct 2018
Event2018 IEEE International Conference on Image Processing: Imaging beyond imagination - Megaron Athens International Conference Centre, Athens, Greece, Athens, Greece
Duration: 7 Oct 201810 Oct 2018
https://2018.ieeeicip.org/default.asp

Conference

Conference2018 IEEE International Conference on Image Processing
LocationMegaron Athens International Conference Centre, Athens, Greece
CountryGreece
CityAthens
Period07/10/201810/10/2018
Internet address
SeriesIEEE International Conference on Image Processing (ICIP)
ISSN2381-8549

Fingerprint

Rehabilitation
Brain
Facial Expression
Long-Term Memory
Short-Term Memory
Hot Temperature
Learning
Wounds and Injuries
Traumatic Brain Injury
Therapeutics

Cite this

Ilyas, C. M. A., Nasrollahi, K., Rehm, M., & Moeslund, T. B. (2018). Rehabilitation of Traumatic Brain Injured Patients: Patient Mood Analysis from Multimodal Video. In 2018 IEEE International Conference on Image Processing: ICIP 2018 (pp. 2291-2295). [8451223] IEEE. IEEE International Conference on Image Processing (ICIP) https://doi.org/10.1109/ICIP.2018.8451223
Ilyas, Chaudhary Muhammad Aqdus ; Nasrollahi, Kamal ; Rehm, Matthias ; Moeslund, Thomas B. / Rehabilitation of Traumatic Brain Injured Patients : Patient Mood Analysis from Multimodal Video. 2018 IEEE International Conference on Image Processing: ICIP 2018. IEEE, 2018. pp. 2291-2295 (IEEE International Conference on Image Processing (ICIP)).
@inproceedings{684b970bc9cc4bcc88eccdaf0c690806,
title = "Rehabilitation of Traumatic Brain Injured Patients: Patient Mood Analysis from Multimodal Video",
abstract = "Rehabilitation after traumatic brain injury (TBI) is very critical as it is largely unpredictable depending upon the nature of the injury. Rehabilitation process and recovery time also varies, as it takes months and years, depending upon the assessment of treatment, mental and physical conditions and strategies. Due to non-cooperative behaviour of patients, and increase in negative emotional expressions it is very beneficial to evaluate these expressions in a contactless way, and perform a rehabilitation physiotherapy, cognitive or other behavioral activities when the patient is in a positive mood. In this paper we have analyzed the methods for facial features extraction for TBI patients to determine optimal time to have aforementioned rehabilitation process on the basis of positive and negative facial expressions. We have employed a deep learning architecture based on convolutional neural network and long short term memory on RGB and thermal data that were collected in challenging scenarios from real patients. It automatically identifies the patient's facial expressions, and inform experts or trainers that {"}it is the time{"} to start rehabilitation session.",
author = "Ilyas, {Chaudhary Muhammad Aqdus} and Kamal Nasrollahi and Matthias Rehm and Moeslund, {Thomas B.}",
year = "2018",
month = "10",
day = "7",
doi = "10.1109/ICIP.2018.8451223",
language = "English",
isbn = "978-1-4799-7062-9",
series = "IEEE International Conference on Image Processing (ICIP)",
pages = "2291--2295",
booktitle = "2018 IEEE International Conference on Image Processing",
publisher = "IEEE",
address = "United States",

}

Ilyas, CMA, Nasrollahi, K, Rehm, M & Moeslund, TB 2018, Rehabilitation of Traumatic Brain Injured Patients: Patient Mood Analysis from Multimodal Video. in 2018 IEEE International Conference on Image Processing: ICIP 2018., 8451223, IEEE, IEEE International Conference on Image Processing (ICIP), pp. 2291-2295, 2018 IEEE International Conference on Image Processing, Athens, Greece, 07/10/2018. https://doi.org/10.1109/ICIP.2018.8451223

Rehabilitation of Traumatic Brain Injured Patients : Patient Mood Analysis from Multimodal Video. / Ilyas, Chaudhary Muhammad Aqdus; Nasrollahi, Kamal; Rehm, Matthias; Moeslund, Thomas B.

2018 IEEE International Conference on Image Processing: ICIP 2018. IEEE, 2018. p. 2291-2295 8451223 (IEEE International Conference on Image Processing (ICIP)).

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

TY - GEN

T1 - Rehabilitation of Traumatic Brain Injured Patients

T2 - Patient Mood Analysis from Multimodal Video

AU - Ilyas, Chaudhary Muhammad Aqdus

AU - Nasrollahi, Kamal

AU - Rehm, Matthias

AU - Moeslund, Thomas B.

PY - 2018/10/7

Y1 - 2018/10/7

N2 - Rehabilitation after traumatic brain injury (TBI) is very critical as it is largely unpredictable depending upon the nature of the injury. Rehabilitation process and recovery time also varies, as it takes months and years, depending upon the assessment of treatment, mental and physical conditions and strategies. Due to non-cooperative behaviour of patients, and increase in negative emotional expressions it is very beneficial to evaluate these expressions in a contactless way, and perform a rehabilitation physiotherapy, cognitive or other behavioral activities when the patient is in a positive mood. In this paper we have analyzed the methods for facial features extraction for TBI patients to determine optimal time to have aforementioned rehabilitation process on the basis of positive and negative facial expressions. We have employed a deep learning architecture based on convolutional neural network and long short term memory on RGB and thermal data that were collected in challenging scenarios from real patients. It automatically identifies the patient's facial expressions, and inform experts or trainers that "it is the time" to start rehabilitation session.

AB - Rehabilitation after traumatic brain injury (TBI) is very critical as it is largely unpredictable depending upon the nature of the injury. Rehabilitation process and recovery time also varies, as it takes months and years, depending upon the assessment of treatment, mental and physical conditions and strategies. Due to non-cooperative behaviour of patients, and increase in negative emotional expressions it is very beneficial to evaluate these expressions in a contactless way, and perform a rehabilitation physiotherapy, cognitive or other behavioral activities when the patient is in a positive mood. In this paper we have analyzed the methods for facial features extraction for TBI patients to determine optimal time to have aforementioned rehabilitation process on the basis of positive and negative facial expressions. We have employed a deep learning architecture based on convolutional neural network and long short term memory on RGB and thermal data that were collected in challenging scenarios from real patients. It automatically identifies the patient's facial expressions, and inform experts or trainers that "it is the time" to start rehabilitation session.

U2 - 10.1109/ICIP.2018.8451223

DO - 10.1109/ICIP.2018.8451223

M3 - Article in proceeding

SN - 978-1-4799-7062-9

T3 - IEEE International Conference on Image Processing (ICIP)

SP - 2291

EP - 2295

BT - 2018 IEEE International Conference on Image Processing

PB - IEEE

ER -

Ilyas CMA, Nasrollahi K, Rehm M, Moeslund TB. Rehabilitation of Traumatic Brain Injured Patients: Patient Mood Analysis from Multimodal Video. In 2018 IEEE International Conference on Image Processing: ICIP 2018. IEEE. 2018. p. 2291-2295. 8451223. (IEEE International Conference on Image Processing (ICIP)). https://doi.org/10.1109/ICIP.2018.8451223