Light Field Based Face Recognition Via A Fused Deep Representation

Alireza Sepas-Moghaddam, Paulo Lobato Correia, Kamal Nasrollahi, Thomas B. Moeslund, Fernando Pereira

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

18 Citations (Scopus)

Abstract

The emergence of light field cameras opens new frontiers in terms of biometric recognition. This paper proposes the first deep CNN solution for light field based face recognition, exploiting the richer information available in a lenslet light field image. Additionally, for the first time, the exploitation of disparity maps together with 2D-RGB images and depth maps has been considered in the context of a fusion scheme to further improve the face recognition performance. The proposed solution uses the 2D-RGB central sub-aperture view as well as the disparity and depth maps extracted from the full set of sub-aperture images associated to a lenslet light field. After, feature extraction is performed using a VGG-Face deep descriptor for texture and independently fine-tuned models for disparity and depth maps. Finally, the extracted features are concatenated to be fed into an SVM classifier. A comprehensive set of experiments has been conducted with the IST-EURECOM light field face database, showing the superior performance of the fused deep representation for varied and challenging recognition tasks.
Original languageEnglish
Title of host publicationIEEE International Workshop on MACHINE LEARNING FOR SIGNAL PROCESSING
EditorsNelly Pustelnik, Zheng-Hua Tan, Zhanyu Ma, Jan Larsen
Number of pages6
PublisherIEEE
Publication date31 Oct 2018
Article number8516966
ISBN (Print)978-153865477-4
ISBN (Electronic)9781538654774
DOIs
Publication statusPublished - 31 Oct 2018
EventIEEE International Workshop on MACHINE LEARNING FOR SIGNAL PROCESSING - Aalborg, Denmark
Duration: 17 Sept 201820 Sept 2018

Conference

ConferenceIEEE International Workshop on MACHINE LEARNING FOR SIGNAL PROCESSING
Country/TerritoryDenmark
CityAalborg
Period17/09/201820/09/2018
SeriesMachine Learning for Signal Processing
ISSN1551-2541

Keywords

  • Depth Map
  • Disparity Map
  • Face Recognition
  • Fine-Tuning
  • Lenslet Light Field Imaging
  • VGG-Face Descriptor

Fingerprint

Dive into the research topics of 'Light Field Based Face Recognition Via A Fused Deep Representation'. Together they form a unique fingerprint.

Cite this