TY - GEN
T1 - Spatio-Temporal Pain Recognition in CNN-based Super-Resolved Facial Images
AU - Bellantonio, Marco
AU - Haque, Mohammad Ahsanul
AU - Rodriguez, Pau
AU - Nasrollahi, Kamal
AU - Telve, Taisi
AU - Guerrero, Sergio Escalera
AU - Gonzàlez, Jordi
AU - Moeslund, Thomas B.
AU - Rasti, Pejman
AU - Anbarjafari, Gholamreza
PY - 2017/3/28
Y1 - 2017/3/28
N2 - Automatic pain detection is a long expected solution to a prevalent medical problem of pain management. This is more relevant when the subject of pain is young children or patients with limited ability to communicate about their pain experience. Computer vision-based analysis of facial pain expression provides a way of efficient pain detection. When deep machine learning methods came into the scene, automatic pain detection exhibited even better performance. In this paper, we figured out three important factors to exploit in automatic pain detection: spatial information available regarding to pain in each of the facial video frames, temporal axis information regarding to pain expression pattern in a subject video sequence, and variation of face resolution. We employed a combination of convolutional neural network and recurrent neural network to setup a deep hybrid pain detection framework that is able to exploit both spatial and temporal pain information from facial video. In order to analyze the effect of different facial resolutions, we introduce a super-resolution algorithm to generate facial video frames with different resolution setups. We investigated the performance on the publicly available UNBC-McMaster Shoulder Pain database. As a contribution, the paper provides novel and important information regarding to the performance of a hybrid deep learning framework for pain detection in facial images of different resolution.
AB - Automatic pain detection is a long expected solution to a prevalent medical problem of pain management. This is more relevant when the subject of pain is young children or patients with limited ability to communicate about their pain experience. Computer vision-based analysis of facial pain expression provides a way of efficient pain detection. When deep machine learning methods came into the scene, automatic pain detection exhibited even better performance. In this paper, we figured out three important factors to exploit in automatic pain detection: spatial information available regarding to pain in each of the facial video frames, temporal axis information regarding to pain expression pattern in a subject video sequence, and variation of face resolution. We employed a combination of convolutional neural network and recurrent neural network to setup a deep hybrid pain detection framework that is able to exploit both spatial and temporal pain information from facial video. In order to analyze the effect of different facial resolutions, we introduce a super-resolution algorithm to generate facial video frames with different resolution setups. We investigated the performance on the publicly available UNBC-McMaster Shoulder Pain database. As a contribution, the paper provides novel and important information regarding to the performance of a hybrid deep learning framework for pain detection in facial images of different resolution.
KW - Super-Resolution
KW - Convolutional Neural Network
KW - Recurrent Neural Network
KW - Pain detection
U2 - 10.1007/978-3-319-56687-0_13
DO - 10.1007/978-3-319-56687-0_13
M3 - Article in proceeding
SN - 978-3-319-56686-3
T3 - Lecture Notes in Computer Science
BT - Video Analytics
PB - Springer
T2 - 23rd international conference on pattern recognition (ICPR 2016)
Y2 - 4 December 2016 through 8 December 2016
ER -