Multimodal Heartbeat Rate Estimation from the Fusion of Facial RGB and Thermal Videos

Anders Skaarup Johansen, Jesper Wædeled Henriksen, Mohammad Ahsanul Haque, Mohammad Naser Sabet Jahromi, Kamal Nasrollahi, Thomas B. Moeslund

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

233 Downloads (Pure)

Abstrakt

Measuring Heartbeat Rate (HR) is an important tool for monitoring the health of a person. When the heart beats the influx of blood to the head causes slight involuntary movement and subtle skin color changes, which cannot be seen by the naked eye but can be tracked from facial videos using computer vision techniques and can be analyzed to estimate the HR. However, the current state of the art solutions encounter an increasing amount of complications when the subject has voluntary motion on the face or when the lighting conditions change in the video. Thus the accuracy of the HR estimation using computer vision is still inferior to that of a physical Electrocardiography (ECG) based system. The aim of this work is to improve the current non-invasive HR measurement by fusing the motion-based and color-based HR estimation methods and using them on multiple input modalities, e.g., RGB and thermal imaging. Our experiments indicate that late-fusion of the results of these methods (motion and color-based) applied to these different modalities, produces more accurate results compared to the existing solutions.
OriginalsprogEngelsk
TitelEleventh International Conference on Machine Vision, ICMV 2018
RedaktørerJianhong Zhou, Antanas Verikas, Dmitry P. Nikolaev, Petia Radeva
Antal sider8
ForlagSPIE - International Society for Optical Engineering
Publikationsdato2019
Artikelnummer110410R
ISBN (Trykt)9781510627482
ISBN (Elektronisk)9781510627482
DOI
StatusUdgivet - 2019
BegivenhedThe 11th International Conference on Machine Vision - Munich, Tyskland
Varighed: 1 nov. 20183 nov. 2018

Konference

KonferenceThe 11th International Conference on Machine Vision
LandTyskland
ByMunich
Periode01/11/201803/11/2018
NavnProceedings of SPIE, the International Society for Optical Engineering
Vol/bind11041
ISSN0277-786X

Fingeraftryk Dyk ned i forskningsemnerne om 'Multimodal Heartbeat Rate Estimation from the Fusion of Facial RGB and Thermal Videos'. Sammen danner de et unikt fingeraftryk.

  • Citationsformater

    Johansen, A. S., Henriksen, J. W., Haque, M. A., Jahromi, M. N. S., Nasrollahi, K., & Moeslund, T. B. (2019). Multimodal Heartbeat Rate Estimation from the Fusion of Facial RGB and Thermal Videos. I J. Zhou, A. Verikas, D. P. Nikolaev, & P. Radeva (red.), Eleventh International Conference on Machine Vision, ICMV 2018 [110410R] SPIE - International Society for Optical Engineering. Proceedings of SPIE, the International Society for Optical Engineering, Bind. 11041 https://doi.org/10.1117/12.2523385