ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition

Jun Wan; Stan Z. Li; Yibing Zhao; Shuai Zhou; Isabelle Guyon; Sergio Escalera

doi:10.1109/CVPRW.2016.100

ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition

Jun Wan, Stan Z. Li, Yibing Zhao, Shuai Zhou, Isabelle Guyon, Sergio Escalera

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

174 Citations (Scopus)

Abstract

In this paper, we present two large video multi-modal datasets for RGB and RGB-D gesture recognition: the ChaLearn LAP RGB-D Isolated Gesture Dataset (IsoGD) and the Continuous Gesture Dataset (ConGD). Both datasets are derived from the ChaLearn Gesture Dataset (CGD) that has a total of more than 50000 gestures for the 'one-shot-learning' competition. To increase the potential of the old dataset, we designed new well curated datasets composed of 249 gesture labels, and including 47933 gestures manually labeled the begin and end frames in sequences. Using these datasets we will open two competitions on the CodaLab platform so that researchers can test and compare their methods for 'user independent' gesture recognition. The first challenge is designed for gesture spotting and recognition in continuous sequences of gestures while the second one is designed for gesture classification from segmented data. The baseline method based on the bag of visual words model is also presented.

Original language	English
Title of host publication	Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016
Number of pages	9
Publisher	IEEE Computer Society Press
Publication date	16 Dec 2016
Pages	761-769
Article number	7789590
ISBN (Electronic)	9781467388504
DOIs	https://doi.org/10.1109/CVPRW.2016.100
Publication status	Published - 16 Dec 2016
Externally published	Yes
Event	29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016 - Las Vegas, United States Duration: 26 Jun 2016 → 1 Jul 2016

Conference

Conference	29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016
Country/Territory	United States
City	Las Vegas
Period	26/06/2016 → 01/07/2016

Series	IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
ISSN	2160-7508

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

Access to Document

10.1109/CVPRW.2016.100

AUB Link

Search for the material in Aalborg University Library's search engine

Cite this

Wan, Jun ; Li, Stan Z. ; Zhao, Yibing et al. / ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition. Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016. IEEE Computer Society Press, 2016. pp. 761-769 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops).

@inproceedings{9e22472714e2437299323a628a6376ff,

title = "ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition",

abstract = "In this paper, we present two large video multi-modal datasets for RGB and RGB-D gesture recognition: the ChaLearn LAP RGB-D Isolated Gesture Dataset (IsoGD) and the Continuous Gesture Dataset (ConGD). Both datasets are derived from the ChaLearn Gesture Dataset (CGD) that has a total of more than 50000 gestures for the 'one-shot-learning' competition. To increase the potential of the old dataset, we designed new well curated datasets composed of 249 gesture labels, and including 47933 gestures manually labeled the begin and end frames in sequences. Using these datasets we will open two competitions on the CodaLab platform so that researchers can test and compare their methods for 'user independent' gesture recognition. The first challenge is designed for gesture spotting and recognition in continuous sequences of gestures while the second one is designed for gesture classification from segmented data. The baseline method based on the bag of visual words model is also presented.",

author = "Jun Wan and Li, {Stan Z.} and Yibing Zhao and Shuai Zhou and Isabelle Guyon and Sergio Escalera",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016 ; Conference date: 26-06-2016 Through 01-07-2016",

year = "2016",

month = dec,

day = "16",

doi = "10.1109/CVPRW.2016.100",

language = "English",

series = "IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops",

pages = "761--769",

booktitle = "Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016",

publisher = "IEEE Computer Society Press",

address = "United States",

}

Wan, J, Li, SZ, Zhao, Y, Zhou, S, Guyon, I & Escalera, S 2016, ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition. in Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016., 7789590, IEEE Computer Society Press, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 761-769, 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016, Las Vegas, United States, 26/06/2016. https://doi.org/10.1109/CVPRW.2016.100

ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition. / Wan, Jun; Li, Stan Z.; Zhao, Yibing et al.
Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016. IEEE Computer Society Press, 2016. p. 761-769 7789590 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops).

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

TY - GEN

T1 - ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition

AU - Wan, Jun

AU - Li, Stan Z.

AU - Zhao, Yibing

AU - Zhou, Shuai

AU - Guyon, Isabelle

AU - Escalera, Sergio

PY - 2016/12/16

Y1 - 2016/12/16

N2 - In this paper, we present two large video multi-modal datasets for RGB and RGB-D gesture recognition: the ChaLearn LAP RGB-D Isolated Gesture Dataset (IsoGD) and the Continuous Gesture Dataset (ConGD). Both datasets are derived from the ChaLearn Gesture Dataset (CGD) that has a total of more than 50000 gestures for the 'one-shot-learning' competition. To increase the potential of the old dataset, we designed new well curated datasets composed of 249 gesture labels, and including 47933 gestures manually labeled the begin and end frames in sequences. Using these datasets we will open two competitions on the CodaLab platform so that researchers can test and compare their methods for 'user independent' gesture recognition. The first challenge is designed for gesture spotting and recognition in continuous sequences of gestures while the second one is designed for gesture classification from segmented data. The baseline method based on the bag of visual words model is also presented.

AB - In this paper, we present two large video multi-modal datasets for RGB and RGB-D gesture recognition: the ChaLearn LAP RGB-D Isolated Gesture Dataset (IsoGD) and the Continuous Gesture Dataset (ConGD). Both datasets are derived from the ChaLearn Gesture Dataset (CGD) that has a total of more than 50000 gestures for the 'one-shot-learning' competition. To increase the potential of the old dataset, we designed new well curated datasets composed of 249 gesture labels, and including 47933 gestures manually labeled the begin and end frames in sequences. Using these datasets we will open two competitions on the CodaLab platform so that researchers can test and compare their methods for 'user independent' gesture recognition. The first challenge is designed for gesture spotting and recognition in continuous sequences of gestures while the second one is designed for gesture classification from segmented data. The baseline method based on the bag of visual words model is also presented.

UR - http://www.scopus.com/inward/record.url?scp=85010202014&partnerID=8YFLogxK

U2 - 10.1109/CVPRW.2016.100

DO - 10.1109/CVPRW.2016.100

M3 - Article in proceeding

AN - SCOPUS:85010202014

T3 - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

SP - 761

EP - 769

BT - Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016

PB - IEEE Computer Society Press

T2 - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016

Y2 - 26 June 2016 through 1 July 2016

ER -

Wan J, Li SZ, Zhao Y, Zhou S, Guyon I, Escalera S. ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition. In Proceedings - 29th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2016. IEEE Computer Society Press. 2016. p. 761-769. 7789590. (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops). doi: 10.1109/CVPRW.2016.100

ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition

Abstract

Conference

Bibliographical note

Access to Document

AUB Link

Other files and links

Fingerprint

Cite this