期刊
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE
卷 118, 期 -, 页码 -出版社
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.engappai.2022.105655
关键词
Digital Twins (DTs); Industry 4; 0; Auto-labeled data generation; Virtual Reality (VR); Human Action Recognition (HAR); Human-Robot Collaboration (HRC)
This study explores the use of digital twins to generate a dataset for human action recognition, enabling human-robot collaboration in working environments. By simulating assembly tasks, a dataset named InHARD-DT was created and used to train and test a neural network. The proposed method shows effective results.
The recognition of human actions based on artificial intelligence methods to enable Human-Robot Collab-oration (HRC) inside working environments remains a challenge, especially because of the necessary huge training datasets needed. Meanwhile, Digital Twins (DTs) of human centered productions are increasingly developed and used in the design and operation phases. As instance, DTs are already helping industries to design, visualize, monitor, manage, and maintain their assets more effectively. However, few works are dealing with using DTs as a dataset generator tool. Therefore, this paper explores the use of a DT of a real industrial workstation involving assembly tasks with a robotic arm interfaced with Virtual Reality (VR) to extract a digital human model. The DT simulates assembly operations performed by humans aiming to generate self-labeled data. Thereby, a Human Action Recognition dataset named InHARD-DT was created to validate a real use case in which we use the acquired auto-labeled DT data of the virtual representation of the InHARD dataset to train a Spatial-Temporal Graph Convolutional Neural Network with skeletal data on one hand. On the other hand, the Physical Twin (PT) data of the InHARD dataset was used for testing. Obtained results show the effectiveness of the proposed method.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据