Rendering Immersive Haptic Force Feedback via Neuromuscular Electrical Stimulation

Haptic feedback is the sensory modality to enhance the so-called immersion, meant as the extent to which senses are engaged by the mediated environment during virtual reality applications. However, it can be challenging to meet this requirement using conventional robotic design approaches that rely on rigid mechanical systems with limited workspace and bandwidth. An alternative solution can be seen in the adoption of lightweight wearable systems equipped with Neuromuscular Electrical Stimulation (NMES): in fact, NMES offers a wide range of different forces and qualities of haptic feedback. In this study, we present an experimental setup able to enrich the virtual reality experience by employing NMES to create in the antagonists' muscles the haptic sensation of being loaded. We developed a subject-specific biomechanical model that estimated elbow torque during object lifting to deliver suitable electrical muscle stimulations. We experimentally tested our system by exploring the differences between the implemented NMES-based haptic feedback (NMES condition), a physical lifted object (Physical condition), and a condition without haptic feedback (Visual condition) in terms of kinematic response, metabolic effort, and participants' perception of fatigue. Our results showed that both in terms of metabolic consumption and user fatigue perception, the condition with electrical stimulation and the condition with the real weight differed significantly from the condition without any load: the implemented feedback was able to faithfully reproduce interactions with objects, suggesting its possible application in different areas such as gaming, work risk assessment simulation, and education.

Automated summary

This study presents an experimental setup that uses Neuromuscular Electrical Stimulation (NMES) to enhance the virtual reality experience by providing haptic feedback. The results of the experiment show significant differences in metabolic consumption and user fatigue perception between the conditions with electrical stimulation and real weight compared to the condition without any load.