Evaluating ANN efficiency in recognizing EEG and Eye-Tracking Evoked Potentials in Visual-Game-Events

Andreas Wulff-Jensen*, Luis Emilio Bruni

*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

36 Downloads (Pure)

Abstract

EEG and Eye-tracking signals have customarily been analyzed and inspected visually in order to be correlated to the controlled stimuli. This pro-cess has proven to yield valid results as long as the stimuli of the experiment are under complete control (e.g.: the order of presentation). In this study, we have recorded the subject’s electroencephalogram and eye-tracking data while they were exposed to a 2D platform game. In the game we had control over the de-sign of each level by choosing the diversity of actions (i.e. events) afforded to the player. However we had no control over the order in which these actions were undertaken. The psychophysiological signals were synchronized to these game events and used to train and test an artificial neural network in order to evaluate how efficiently such a tool can help us in establishing the correlation, and therefore differentiating among the different categories of events. The high-est average accuracies were between 60.25% - 72.07%, hinting that it is feasible to recognize reactions to complex uncontrolled stimuli, like game events, using artificial neural networks.
Original languageEnglish
Title of host publicationAdvances in Neuroergonomics and Cognitive Engineering : Proceedings of the AHFE 2017 International Conference on Neuroergonomics and Cognitive Engineering, July 17–21, 2017, The Westin Bonaventure Hotel, Los Angeles, California, USA
EditorsCarryl Baldwin
Number of pages13
PublisherSpringer Publishing Company
Publication date13 Jun 2017
Pages262-274
Article number25
Chapter5
ISBN (Print)978-3-319-60641-5
ISBN (Electronic)978-3-319-60642-2
DOIs
Publication statusPublished - 13 Jun 2017
EventAHFE 2017 International Conference on Neuroergonomics and Cognitive Engineering, 2017 - Los Angeles, United States
Duration: 17 Jun 201721 Jun 2017

Conference

ConferenceAHFE 2017 International Conference on Neuroergonomics and Cognitive Engineering, 2017
Country/TerritoryUnited States
CityLos Angeles
Period17/06/201721/06/2017
SeriesAdvances in Intelligent Systems and Computing
Volume586
ISSN2194-5357

Keywords

  • Artificial neural network
  • machine learning
  • Electroencephalogram
  • eye-tracking
  • games
  • pupillometry
  • game events
  • psychophysiology

Fingerprint

Dive into the research topics of 'Evaluating ANN efficiency in recognizing EEG and Eye-Tracking Evoked Potentials in Visual-Game-Events'. Together they form a unique fingerprint.

Cite this