4.7 Article

Multi-Scale Sparse Graph Convolutional Network For the Assessment of Parkinsonian Gait

期刊

IEEE TRANSACTIONS ON MULTIMEDIA
卷 24, 期 -, 页码 1583-1594

出版社

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMM.2021.3068609

关键词

Feature extraction; Deep learning; Pose estimation; Bones; Legged locomotion; Joints; Correlation; Parkinson's disease; gait motor disorder; video-based assessment; graph convolutional network; model-driven deep learning

向作者/读者索取更多资源

Automated assessment of gait motor disorder in Parkinson's disease patients is urgently needed in clinical practice. This study proposes a novel graph convolutional network model for video assessment of PD gait motor disorder. The model can simultaneously model spatial information and temporal variations, and extract discriminative features through a multi-scale attention mechanism. Experimental results on a clinical video dataset demonstrate the good performance of the proposed model, outperforming existing assessment methods.
Automated assessment of patients with Parkinson's disease (PD) is urgently required in clinical practice to improve the diagnostic efficiency and objectivity and to remotely monitor the motor disorder symptoms and general health of these patients, especially in view of the travel restrictions due to the recent coronavirus epidemic. Gait motor disorder is one of the critical manifestations of PD, and automated assessment of gait is vital to realize automated assessment of PD patients. To this end, we propose a novel two-stream spatial-temporal attention graph convolutional network (2s-ST-AGCN) for video assessment of PD gait motor disorder. Specifically, the skeleton sequence of human body is extracted from videos to construct spatial-temporal graphs of joints and bones, and a two-stream spatial-temporal graph convolutional network is then built to simultaneously model the static spatial information and dynamic temporal variations. The multi-scale spatial-temporal attention-aware mechanism is also designed to effectively extract the discriminative spatial-temporal features. The deep supervision strategy is then embedded to minimize classification errors, thereby guiding the weight update process of the hidden layer to promote significant discriminative features. Besides, two model-driven terms are integrated into this deep learning framework to strengthen multi-scale similarity in the deep supervision and realize sparsification of discriminative features. Extensive experiments on the clinical video dataset show that the proposed model exhibits good performance with an accuracy of 65.66% and an acceptable accuracy of 98.90%, which is much better than that of the existing sensor- and vision-based methods for Parkinsonian gait assessment. Thus, the proposed method is potentially useful for assessing PD gait motor disorder in clinical practice.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据