Journal
COMPUTERS & GRAPHICS-UK
Volume 102, Issue -, Pages 460-473Publisher
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.cag.2021.09.007
Keywords
Supervised learning; Generative adversarial networks (GANs); Haptic rendering; Electrovibration surface; Tactile simulation; Fabrics
Categories
Funding
- Young Scientists Scheme of the National Natural Science Foundation of China [61907037]
- Centre for Applied Computing and Interactive Media (ACIM) of School of Creative Media, City University of Hong Kong
- National Key Research and Development Program of China [2019B010149001]
- National Natural Science Foundation of China [61631010, 61960206007, 62172346]
- Guangdong Basic and Applied Basic Research Foundation [2021A1515011893]
- 111 Project, China [B18005]
- JSPS KAKENHI [20K21801, 21H03478]
- Applied Research Grant [9667189]
- Grants-in-Aid for Scientific Research [21H03478, 20K21801] Funding Source: KAKEN
Ask authors/readers for more resources
This paper presents a deep-learning-based framework for generating frictional signals from textured images of fabric materials to simulate tactile feedback. The experimental results demonstrate that the generated frictional signals are visually and statistically close to the ground-truth signals, and users are unable to distinguish between them.
The electrovibration tactile display could render the tactile feeling of different textured surfaces by generating the frictional force through voltage modulation. When a user is sliding his/her finger on the display surface, he/she can feel the frictional texture. However, it is not trivial to prepare and fine-tune the appropriate frictional signals for haptic design and texture simulation. In this paper, we present a deep-learning-based framework to generate the frictional signals from the textured images of fabric materials. The generated frictional signal can be used for the tactile rendering on the electrovibration tactile display. Leveraging GANs (Generative Adversarial Networks), our system could generate the displacement-based data of frictional coefficients for the tactile display to simulate the tactile feedback of different fabric materials. Our experimental results show that the proposed generative model could generate the frictional-coefficient signals visually and statistically close to the ground-truth signals. The following user studies on fabric-texture simulation show that users could not discriminate the generated and the ground-truth frictional signals being rendered on the electrovibration tactile display, suggesting the effectiveness of our deep-frictional-signal-generation model. (C) 2021 Elsevier Ltd. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available