Computer Science · Computer Vision and Pattern Recognition
Higher-level representation of local spatio-temporal features for human action recognition using Subspace Matching Kernels
Bisser Raytchev, Hideaki Kawamoto, Toru Tamaki, Kazufumi Kaneda
See on the mapAbstract
Although the design of low-level local spatiotemporal features has recently led to significant improvement of performance in many action recognition applications, much less attention has been given to the equally important problem how to organize such low-level features extracted from the videos into a higher-level representation suitable to represent and discriminate between many different action classes. In this paper we propose an alternative approach to the widely-used Bag-of-Features (BoF), where instead of histograms of visual words, action sequences are represented as sets of low-dimensional linear subspaces. This results in richer and more discriminative models. In order to be able to calculate similarities between sets of subspaces we define a novel Subspace Matching Kernel. Experimental results are shown on the widely used KTH action dataset, which demonstrate the effectiveness of the proposed framework.