Changes in Facial Expression as Biometric: A Database and Benchmarks of Identification

Rain Eric Haamer, Kaustubh Kulkarni, Nasrin Imanpour, Mohammad Ahsanul Haque, Egils Avots, Michelle Breisch, Kamal Nasrollahi, Sergio Escalera Guerrero, Cagri Ozcinar, Xavier Baro, Ahmad Reza Naghsh-Nilchi, Thomas B. Moeslund, Gholamreza Anbarjafari

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

12 Citationer (Scopus)
305 Downloads (Pure)

Abstrakt

Facial dynamics can be considered as unique signatures for discrimination between people. These have started to become important topic since many devices have the possibility of unlocking using face recognition or verification. In this work, we evaluate the efficacy of the transition frames of video in emotion as compared to the peak emotion frames for identification. For experiments with transition frames we extract features from each frame of the video from a fine-tuned VGG-Face Convolutional Neural Network (CNN) and geometric features from facial landmark points. To model the temporal context of the transition frames we train a Long-Short Term Memory (LSTM) on the geometric and the CNN features. Furthermore, we employ two fusion strategies: first, an early fusion, in which the geometric and the CNN features are stacked and fed to the LSTM. Second, a late fusion, in which the prediction of the LSTMs, trained
independently on the two features, are stacked and used with a Support Vector Machine (SVM). Experimental results show that the late fusion strategy gives the best results and the transition frames give better identification results as compared to the peak emotion frames.
OriginalsprogEngelsk
Titel13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018)
Antal sider8
ForlagIEEE
Publikationsdato2018
Sider621-628
Artikelnummer8373891
ISBN (Trykt)978-1-5386-2336-7
ISBN (Elektronisk)978-1-5386-2335-0
DOI
StatusUdgivet - 2018
BegivenhedIEEE Conf. on Automatic Face and Gesture Recognition Workshops - X'ian, Kina
Varighed: 15 maj 201819 maj 2018
https://fg2018.cse.sc.edu

Konference

KonferenceIEEE Conf. on Automatic Face and Gesture Recognition Workshops
LandKina
ByX'ian
Periode15/05/201819/05/2018
Internetadresse

Fingeraftryk Dyk ned i forskningsemnerne om 'Changes in Facial Expression as Biometric: A Database and Benchmarks of Identification'. Sammen danner de et unikt fingeraftryk.

  • Citationsformater

    Haamer, R. E., Kulkarni, K., Imanpour, N., Haque, M. A., Avots, E., Breisch, M., Nasrollahi, K., Guerrero, S. E., Ozcinar, C., Baro, X., Naghsh-Nilchi, A. R., Moeslund, T. B., & Anbarjafari, G. (2018). Changes in Facial Expression as Biometric: A Database and Benchmarks of Identification. I 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) (s. 621-628). [8373891] IEEE. https://doi.org/10.1109/FG.2018.00098