GAMEREHAB@HOME: A New Engineering System Using Serious Game and Multisensor Fusion for Functional Rehabilitation at Home

Biomedical-connected objects, such as kinematic sensors, have been commonly used for patient monitoring in many clinical applications. Moreover, serious games have become widely used to improve patients' motivation during functional rehabilitation. In this article, we develop and evaluate a new engineering system as a solution for functional rehabilitation at home. A multisensor fusion between Kinect camera and inertial sensors was developed to animate a 3-D avatar during rehabilitation and to estimate kinematic data of different joints for clinical monitoring. Two serious game scenarios were designed for upper and lower limb rehabilitation. The developed system was evaluated through patient kinematic data and a questionnaire-based approach with a panel of eight poststroke patients and four clinical experts. The evaluation of the system showed that multisensor fusion provides useful data for clinical follow-up. The virtual game scenarios lead to a high level of immersion for patients. Feedback from clinical experts concerning the system's graphical user interfaces and the clinical relevance of the acquired data for each rehabilitation session are positive. The developed system paves the way to deploy recent technologies, such as multisensor fusion and serious games, as a solution for home-based rehabilitation, which can optimize the benefit of the involved patients and medical experts.

Automated summary

The study developed a new engineering system for home-based rehabilitation, utilizing multisensor fusion and serious games to improve patient motivation and provide clinical monitoring data. Evaluation with patient data and questionnaires confirmed the system's effectiveness in clinical follow-up and the high level of patient engagement in virtual game scenarios designed.