Making Sense of Spatio-Temporal Preserving Representations for EEG-Based Human Intention Recognition

Dalin Zhang*, Lina Yao, Kaixuan Chen, Sen Wang, Xiaojun Chang, Yunhao Liu

*Corresponding author for this work

Research output: Contribution to journalJournal articleResearchpeer-review

261 Citations (Scopus)

Abstract

Brain-computer interface (BCI) is a system empowering humans to communicate with or control the outside world with exclusively brain intentions. Electroencephalography (EEG)-based BCI is one of the promising solutions due to its convenient and portable instruments. Despite the extensive research of EEG in recent years, it is still challenging to interpret EEG signals effectively due to its nature of noise and difficulties in capturing the inconspicuous relations between EEG signals and specific brain activities. Most existing works either only consider EEG as chain-like sequences while neglecting complex dependencies between adjacent signals or requiring complex preprocessing. In this paper, we introduce two deep learning-based frameworks with novel spatio-temporal preserving representations of raw EEG streams to precisely identify human intentions. The two frameworks consist of both convolutional and recurrent neural networks effectively exploring the preserved spatial and temporal information in either a cascade or a parallel manner. Extensive experiments on a large scale movement intention EEG dataset (108 subjects, 3 145 160 EEG records) have demonstrated that the proposed frameworks achieve high accuracy of 98.3% and outperform a set of state-of-the-art and baseline models. The developed models are further evaluated with a real-world brain typing BCI and achieve a recognition accuracy of 93% over five instruction intentions suggesting good generalization over different kinds of intentions and BCI systems.

Original languageEnglish
Article number8698218
JournalIEEE Transactions on Cybernetics
Volume50
Issue number7
Pages (from-to)3033-3044
Number of pages12
ISSN2168-2267
DOIs
Publication statusPublished - Jul 2020
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2013 IEEE.

Keywords

  • Brain-computer interface (BCI)
  • electroencephalography (EEG)
  • intention recognition
  • spatial information
  • temporal information

Fingerprint

Dive into the research topics of 'Making Sense of Spatio-Temporal Preserving Representations for EEG-Based Human Intention Recognition'. Together they form a unique fingerprint.

Cite this