Multi-agent attentional activity recognition

Kaixuan Chen, Lina Yao, Dalin Zhang, Bin Guo, Zhiwen Yu

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

19 Citationer (Scopus)


Multi-modality is an important feature of sensor based activity recognition. In this work, we consider two inherent characteristics of human activities, the spatially-temporally varying salience of features and the relations between activities and corresponding body part motions. Based on these, we propose a multi-agent spatial-temporal attention model. The spatial-temporal attention mechanism helps intelligently select informative modalities and their active periods. And the multiple agents in the proposed model represent activities with collective motions across body parts by independently selecting modalities associated with single motions. With a joint recognition goal, the agents share gained information and coordinate their selection policies to learn the optimal recognition model. The experimental results on four real-world datasets demonstrate that the proposed model outperforms the state-of-the-art methods.

TitelProceedings of the 28th International Joint Conference on Artificial Intelligence, IJCAI 2019
RedaktørerSarit Kraus
Antal sider7
ForlagInternational Joint Conferences on Artificial Intelligence
ISBN (Elektronisk)9780999241141
StatusUdgivet - 2019
Udgivet eksterntJa
Begivenhed28th International Joint Conference on Artificial Intelligence, IJCAI 2019 - Macao, Kina
Varighed: 10 aug. 201916 aug. 2019


Konference28th International Joint Conference on Artificial Intelligence, IJCAI 2019
SponsorBaidu, et al., Huawei Technologies Co., Ltd., International Joint Conferences on Artifical Intelligence (IJCAI), Sony Group Corporation, Xiao-i
NavnIJCAI International Joint Conference on Artificial Intelligence

Bibliografisk note

Publisher Copyright:
© 2019 International Joint Conferences on Artificial Intelligence. All rights reserved.


Dyk ned i forskningsemnerne om 'Multi-agent attentional activity recognition'. Sammen danner de et unikt fingeraftryk.