First Impressions: A Survey on Vision-Based Apparent Personality Trait Analysis

Julio C.S. Jacques Junior*, Yagmur Gucluturk, Marc Perez, Umut Guclu, Carlos Andujar, Xavier Baro, Hugo Jair Escalante, Isabelle Guyon, Marcel A.J. Van Gerven, Rob Van Lier, Sergio Escalera

*Corresponding author for this work

Research output: Contribution to journalJournal articleResearchpeer-review

35 Citations (Scopus)

Abstract

Personality analysis has been widely studied in psychology, neuropsychology, and signal processing fields, among others. From the past few years, it also became an attractive research area in visual computing. From the computational point of view, by far speech and text have been the most considered cues of information for analyzing personality. However, recently there has been an increasing interest from the computer vision community in analyzing personality from visual data. Recent computer vision approaches are able to accurately analyze human faces, body postures and behaviors, and use these information to infer apparent personality traits. Because of the overwhelming research interest in this topic, and of the potential impact that this sort of methods could have in society, we present in this paper an up-to-date review of existing vision-based approaches for apparent personality trait recognition. We describe seminal and cutting edge works on the subject, discussing and comparing their distinctive features and limitations. Future venues of research in the field are identified and discussed. Furthermore, aspects on the subjectivity in data labeling/evaluation, as well as current datasets and challenges organized to push the research on the field are reviewed.

Original languageEnglish
JournalIEEE Transactions on Affective Computing
Volume13
Issue number1
Pages (from-to)75-95
Number of pages21
ISSN2371-9850
DOIs
Publication statusPublished - 2022
Externally publishedYes

Bibliographical note

Funding Information:
This project has been partially supported by granted Spanish Ministry projects TIN2016-74946-P, TIN2015-66951-C2-2-R and TIN2017-88515-C2-1-R. This work is partially supported by ICREA under the ICREA Academia programme. We thank ChaLearn Looking at People sponsors for their support, including Microsoft Research, Google, NVIDIA Corporation, Amazon, Facebook and Disney Research.

Publisher Copyright:
© 2010-2012 IEEE.

Keywords

  • big-five
  • computer vision
  • facial expression
  • firs impressions
  • gesture
  • machine learning
  • multi-modal recognition
  • nonverbal signals
  • person perception
  • Personality computing
  • speech analysis
  • subjective bias

Fingerprint

Dive into the research topics of 'First Impressions: A Survey on Vision-Based Apparent Personality Trait Analysis'. Together they form a unique fingerprint.

Cite this