3.8 Proceedings Paper

An unobtrusive upper-limb activity recognition system based on deep neural network fusion for stroke survivors

出版社

ASSOC COMPUTING MACHINERY
DOI: 10.1145/3574198.3574223

关键词

Stroke; Deep neural network; Hand gesture recognition

向作者/读者索取更多资源

Stroke survivors can benefit from personalized treatment, and this paper proposes an unobtrusive upper-limb movement recognition system for them based on model fusion. The system achieves high accuracy in hand gesture recognition and is expected to assist rehabilitation physicians in providing better-personalized treatment.
Stroke is a cerebrovascular disease that may cause long-term paralysis. Stroke survivors can recover more quickly with personalized treatment, which often requires the identification and evaluation of daily activities. Most of the existing methods for stroke activity recognition use wearable devices to collect motion and/or electrophysiology signals. However, as most survivors are elderly, the wearing process and operation methods are inevitably inconvenient for them. In this paper, we proposed an unobtrusive upper-limb movement recognition system for stroke survivors based on model fusion via combining three deep neural networks. Specifically, we recruited 16 stroke survivors with different impairment levels. Considering fine and dexterous movements of the upper limbs and hands take an important part in our daily life, fine-grained hand activities are more difficult to recognize. We conducted seventeen hand gesture recognition using video data collected by an Azure Kinect sensor. We compared the performance of three state-of-the-art deep neural networks, namely TSN, I3D, and Slowfast. Moreover, we fused the three models using soft voting. The top1 mean accuracy of our fusion model is 93.45% on our dataset. With our method, it is expected to assist rehabilitation physicians, to formulate the corresponding treatment plan, and make better-personalized treatment for stroke survivors.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

3.8
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据