期刊
PATTERN RECOGNITION
卷 81, 期 -, 页码 23-35出版社
ELSEVIER SCI LTD
DOI: 10.1016/j.patcog.2018.03.030
关键词
Content and style; Action recognition; Person identification from motions; Skeleton transformation; Multi-task RNN
资金
- National Key Research and Development Program of China [2016YFB1001000]
- National Natural Science Foundation of China [61525306, 61633021, 61721004, 61420106015]
- Capital Science and Technology Leading Talent Training Project [Z181100006318030]
- Beijing Natural Science Foundation [4162058]
Humans are able to simultaneously identify a person and recognize his or her action based on biological motions. Previous work usually treats action recognition and person identification from motions as two separate tasks with different objectives. In this paper, we present an end-to-end framework to perform these two tasks together. Inspired by the recent success of deep recurrent neural networks (RNN) for skeleton based action recognition, we propose a new pipeline to recognize both actions and persons from skeletons extracted by RGBD sensors. The structure includes two subnets and is end-to-end trainable. The former is skeleton transformation, which accommodates viewpoint changes and noise. The latter is multi-task RNN for joint learning and various architectures are explored including a novel architecture that learns the joint probability between the two output variables. Experiments on 3D action recognition benchmark datasets demonstrate the benefits of multi-task learning and our method dramatically outperforms the existing state-of-the-art in action recognition. (C) 2018 Elsevier Ltd. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据