TY - JOUR
T1 - A Novel Deep Network Architecture for Reconstructing RGB Facial Images from Thermal for Face Recognition
AU - Litvin, Andre
AU - Nasrollahi, Kamal
AU - Ozcinar, Cagri
AU - Guerrero, Sergio Escalera
AU - Moeslund, Thomas B.
AU - Anbarjafari, Gholamreza
PY - 2019/9/30
Y1 - 2019/9/30
N2 - This work proposes a fully convolutional network architecture for RGB face image generation from a given input thermal face image to be applied in face recognition scenarios. The proposed method is based on the FusionNet architecture and increases robustness against overfitting using dropout after bridge connections, randomised leaky ReLUs (RReLUs), and orthogonal regularization. Furthermore, we propose to use a decoding block with resize convolution instead of transposed convolution to improve final RGB face image generation. To validate our proposed network architecture, we train a face classifier and compare its face recognition rate on the reconstructed RGB images from the proposed architecture, to those when reconstructing images with the original FusionNet, as well as when using the original RGB images. As a result, we are introducing a new architecture which leads to a more accurate network.
AB - This work proposes a fully convolutional network architecture for RGB face image generation from a given input thermal face image to be applied in face recognition scenarios. The proposed method is based on the FusionNet architecture and increases robustness against overfitting using dropout after bridge connections, randomised leaky ReLUs (RReLUs), and orthogonal regularization. Furthermore, we propose to use a decoding block with resize convolution instead of transposed convolution to improve final RGB face image generation. To validate our proposed network architecture, we train a face classifier and compare its face recognition rate on the reconstructed RGB images from the proposed architecture, to those when reconstructing images with the original FusionNet, as well as when using the original RGB images. As a result, we are introducing a new architecture which leads to a more accurate network.
KW - Face recognition
KW - Fully convolutional networks
KW - FusionNet
KW - Thermal imaging
UR - http://www.scopus.com/inward/record.url?scp=85066282792&partnerID=8YFLogxK
U2 - 10.1007/s11042-019-7667-4
DO - 10.1007/s11042-019-7667-4
M3 - Journal article
SN - 1380-7501
VL - 78
SP - 25259
EP - 25271
JO - Multimedia Tools and Applications
JF - Multimedia Tools and Applications
IS - 18
ER -