Audio-Visual Classification of Sports Types

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

Abstract

In this work we propose a method for classification of sports types from combined audio and visual features ex- tracted from thermal video. From audio Mel Frequency Cepstral Coefficients (MFCC) are extracted, and PCA are applied to reduce the feature space to 10 dimensions. From the visual modality short trajectories are constructed to rep- resent the motion of players. From these, four motion fea- tures are extracted and combined directly with audio fea- tures for classification. A k-nearest neighbour classifier is applied for classification of 180 1-minute video sequences from three sports types. Using 10-fold cross validation a correct classification rate of 96.11% is obtained with multi- modal features, compared to 86.67% and 90.00% using only visual or audio features, respectively.
Close

Details

In this work we propose a method for classification of sports types from combined audio and visual features ex- tracted from thermal video. From audio Mel Frequency Cepstral Coefficients (MFCC) are extracted, and PCA are applied to reduce the feature space to 10 dimensions. From the visual modality short trajectories are constructed to rep- resent the motion of players. From these, four motion fea- tures are extracted and combined directly with audio fea- tures for classification. A k-nearest neighbour classifier is applied for classification of 180 1-minute video sequences from three sports types. Using 10-fold cross validation a correct classification rate of 96.11% is obtained with multi- modal features, compared to 86.67% and 90.00% using only visual or audio features, respectively.
Original languageEnglish
Title of host publication2015 IEEE International Conference on Computer Vision Workshops (ICCVW)
PublisherIEEE
Publication dateDec 2015
Pages768-773
ISBN (Print)978-1-4673-8390-5
DOI
Publication statusPublished - Dec 2015
Publication categoryResearch
Peer-reviewedYes
EventInternational Conference on Computer Vision - Santiago, Chile
Duration: 12 Dec 201518 Dec 2015

Conference

ConferenceInternational Conference on Computer Vision
LandChile
BySantiago
Periode12/12/201518/12/2015

Download statistics

No data available
ID: 223571037