Spatiotemporal Analysis of RGB-D-T Facial Images for Multimodal Pain Level Recognition

Ramin Irani, Kamal Nasrollahi, Marc Oliu Simon, Ciprian Corneanu, Sergio Escalera Guerrero, Chris Bahnsen, Dennis Holm Lundtoft, Thomas B. Moeslund, Tanja Pedersen, Marie-Louise Klitgaard, Laura Petrini

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

29 Citations (Scopus)
932 Downloads (Pure)

Abstract

Pain is a vital sign of human health and its automatic detection
can be of crucial importance in many different contexts,
including medical scenarios. While most available
computer vision techniques are based on RGB, in this paper,
we investigate the effect of combining RGB, depth, and thermal
facial images for pain detection and pain intensity level
recognition. For this purpose, we extract energies released
by facial pixels using a spatiotemporal filter. Experiments
on a group of 12 elderly people applying the multimodal approach
show that the proposed method successfully detects
pain and recognizes between three intensity levels in 82%
of the analyzed frames improving more than 6% over RGB
only analysis in similar conditions.
Original languageEnglish
Title of host publicationIEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRW), 2015
PublisherIEEE Computer Society Press
Publication date7 Jun 2015
Pages88-95
ISBN (Print)978-1-4673-6759-2
DOIs
Publication statusPublished - 7 Jun 2015
Event2015 IEEE Conference on Computer Vision and Pattern Recognition Workshop: Looking at People - Boston, United States
Duration: 6 Jun 201512 Jun 2015

Conference

Conference2015 IEEE Conference on Computer Vision and Pattern Recognition Workshop
Country/TerritoryUnited States
CityBoston
Period06/06/201512/06/2015

Fingerprint

Dive into the research topics of 'Spatiotemporal Analysis of RGB-D-T Facial Images for Multimodal Pain Level Recognition'. Together they form a unique fingerprint.

Cite this