期刊
CIRP ANNALS-MANUFACTURING TECHNOLOGY
卷 71, 期 1, 页码 377-380出版社
ELSEVIER
DOI: 10.1016/j.cirp.2022.04.016
关键词
Human robot collaboration; Manufacturing system; Visual reasoning
This paper proposes a visual reasoning-based approach for mutual-cognitive human-robot collaboration (HRC), which integrates robotic and human cognitions efficiently. It establishes a domain-specific HRC knowledge graph and perceives the holistic manufacturing scene as a temporal graph using visual sensors. Collaborative modes with similar instructions can be inferred by graph embedding, and mutual-cognitive decisions are implemented in the Augmented Reality execution loop for intuitive HRC support.
Human-robot collaboration (HRC) allows seamless communication and collaboration between humans and robots to fulfil flexible manufacturing tasks in a shared workspace. Nevertheless, existing HRC systems lack an efficient integration of robotic and human cognitions. Empowered by advanced cognitive computing, this paper proposes a visual reasoning-based approach for mutual-cognitive HRC. Firstly, a domain-specific HRC knowl-edge graph is established. Next, the holistic manufacturing scene is perceived by visual sensors as a temporal graph. Then, a collaborative mode with similar instructions can be inferred by graph embedding. Lastly, mutual-cognitive decisions are immersed into the Augmented Reality execution loop for intuitive HRC support. (c) 2022 The Author(s). Published by Elsevier Ltd on behalf of CIRP. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/)
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据