Journal
JOURNAL OF NEURAL ENGINEERING
Volume 18, Issue 5, Pages -Publisher
IOP Publishing Ltd
DOI: 10.1088/1741-2552/ac2a8d
Keywords
artificial intelligence; deep learning; electroneurography (ENG); motor decoding; NVIDIA Jetson Nano; neuroprosthesis; peripheral nerve
Categories
Funding
- DARPA [HR0011-172-0060, N66001-15-C-4016]
- MnDRIVE Program
- Institute for Engineering in Medicine at the University of Minnesota
- NIH [R01-MH111413-01]
- NSF CAREER Award [1845709]
- Fasikl Incorporated
- Directorate For Engineering
- Div Of Electrical, Commun & Cyber Sys [1845709] Funding Source: National Science Foundation
Ask authors/readers for more resources
This study demonstrates the implementation of a neuroprosthetic hand with embedded deep learning-based control, utilizing edge computing devices to reduce computational requirements and enable real-time control. The system shows high accuracy and low latency in controlling individual finger movements in various environments.
Objective. Deep learning-based neural decoders have emerged as the prominent approach to enable dexterous and intuitive control of neuroprosthetic hands. Yet few studies have materialized the use of deep learning in clinical settings due to its high computational requirements. Approach. Recent advancements of edge computing devices bring the potential to alleviate this problem. Here we present the implementation of a neuroprosthetic hand with embedded deep learning-based control. The neural decoder is designed based on the recurrent neural network architecture and deployed on the NVIDIA Jetson Nano-a compacted yet powerful edge computing platform for deep learning inference. This enables the implementation of the neuroprosthetic hand as a portable and self-contained unit with real-time control of individual finger movements. Main results. A pilot study with a transradial amputee is conducted to evaluate the proposed system using peripheral nerve signals acquired from implanted intrafascicular microelectrodes. The preliminary experiment results show the system's capabilities of providing robust, high-accuracy (95%-99%) and low-latency (50-120 ms) control of individual finger movements in various laboratory and real-world environments. Conclusion. This work is a technological demonstration of modern edge computing platforms to enable the effective use of deep learning-based neural decoders for neuroprosthesis control as an autonomous system. Significance. The proposed system helps pioneer the deployment of deep neural networks in clinical applications underlying a new class of wearable biomedical devices with embedded artificial intelligence. Clinical trial registration: DExterous Hand Control Through Fascicular Targeting (DEFT). Identifier: NCT02994160.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available