期刊
IEEE ACCESS
卷 6, 期 -, 页码 52277-52285出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/ACCESS.2018.2869790
关键词
Action recognition; 3D convolutional network; LSTM
资金
- Project of Local Colleges' and Universities' Capacity Construction of Science and Technology Commission in Shanghai [15590501300]
- National Natural Science Foundation of China [61802253, 61461021, 61603242, 61772328]
- Collaborative Innovation Center for Economic Crime Investigation and Prevention Technology of Jiangxi Province [JXJZXTCX-027, JXJZXTCX-030]
- Shanghai Chenguang Talented Program [17CG59]
- Ministry of Science and ICT (MSIT), South Korea [IITP-2018-2015-0-00378]
- Basic Science Research Program through the NRF - Ministry of Education [GR2016R1D1A3B03931911]
- National Research Foundation of Korea [2016R1D1A3B03931911] Funding Source: Korea Institute of Science & Technology Information (KISTI), National Science & Technology Information Service (NTIS)
Human action monitoring can be advantageous to remotely monitor the status of patients or elderly person for intelligent healthcare. Human action recognition enables efficient and accurate monitoring of human behaviors, which can exhibit multifaceted complexity attributed to disparities in viewpoints, personality, resolution and motion speed of individuals, etc. The spatial-temporal information plays an important role in the human action recognition. In this paper, we proposed a novel deep learning architecture named as recurrent 3D convolutional neural network (R3D) to extract effective and discriminative spatial-temporal features to be used for action recognition, which enables the capturing of long-range temporal information by aggregating the 3D convolutional network entries to serve as an input to the LSTM (Long Short-Term Memory) architecture. The 3D convolutional network and LSTM are two effective methods for extracting the temporal information. The proposed R3D network integrated these two methods by sharing a shared 3D convolutional network in sliding windows on video streaming to capturing short-term spatial-temporal features into the LSTM. The output features of LSTM encapsulate the long-range spatial-temporal information representing high-level abstraction of the human actions. The proposed algorithm is compared to traditional and the-state-of-the-art and deep learning algorithms. The experimental results demonstrated the effectiveness of the proposed system, which can be used as smart monitoring for remote healthcare.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据