期刊
IET COMPUTER VISION
卷 10, 期 6, 页码 537-544出版社
WILEY
DOI: 10.1049/iet-cvi.2015.0408
关键词
video signal processing; image segmentation; image recognition; neural nets; hidden Markov models; Gaussian processes; continuous action segmentation; continuous action recognition; hybrid convolutional neural network-hidden Markov model model; isolated action recognition; convolutional neural network; HMM; statistical dependences; CNN-HMM; Gaussian mixture model; Viterbi algorithm
资金
- Open Project Program of the State Key Laboratory of Mathematical Engineering and Advanced Computing [2015A04]
Continuous action recognition in video is more complicated compared with traditional isolated action recognition. Besides the high variability of postures and appearances of each action, the complex temporal dynamics of continuous action makes this problem challenging. In this study, the authors propose a hierarchical framework combining convolutional neural network (CNN) and hidden Markov model (HMM), which recognises and segments continuous actions simultaneously. The authors utilise the CNN's powerful capacity of learning high level features directly from raw data, and use it to extract effective and robust action features. The HMM is used to model the statistical dependences over adjacent sub-actions and infer the action sequences. In order to combine the advantages of these two models, the hybrid architecture of CNN-HMM is built. The Gaussian mixture model is replaced by CNN to model the emission distribution of HMM. The CNN-HMM model is trained using embedded Viterbi algorithm, and the data used to train CNN are labelled by forced alignment. The authors test their method on two public action dataset Weizmann and KTH. Experimental results show that the authors' method achieves improved recognition and segmentation accuracy compared with several other methods. The superior property of features learnt by CNN is also illustrated.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据