Journal
JOURNAL OF INTELLIGENT MANUFACTURING
Volume 32, Issue 4, Pages 1129-1146Publisher
SPRINGER
DOI: 10.1007/s10845-020-01606-w
Keywords
Deep learning; Convolutional neural network; Faster region-based convolutional neural network; Human-machine interaction; Skill transfer
Funding
- Ministry of Science and Technology of the Republic of China (Taiwan)
- MOST [107-2221-E-011-101-MY3]
Ask authors/readers for more resources
This study presents a new skill transfer support model in a manufacturing scenario, utilizing deep learning technology to enhance the skill development of junior operators. The proposed model shows high accuracy in action recognition and object detection, providing effective guidance for junior operators through practical case studies.
The paradigm shift toward Industry 4.0 is not solely completed by enabling smart machines in a factory but also by facilitating human capability. Refinement of work processes and introduction of new training approaches are necessary to support efficient human skill development. This study proposes a new skill transfer support model in a manufacturing scenario. The proposed model develops two types of deep learning as the backbone: a convolutional neural network (CNN) for action recognition and a faster region-based CNN (R-CNN) for object detection. A case study using toy assembly is conducted utilizing two cameras with different angles to evaluate the performance of the proposed model. The accuracy for CNN and faster R-CNN for the target job reached 94.5% and 99%, respectively. A junior operator can be guided by the proposed model given that flexible assembly tasks have been constructed on the basis of a skill representation. In terms of theoretical contribution, this study integrated two deep learning models that can simultaneously recognize the action and detect the object. The present study facilitates skill transfer in manufacturing systems by adapting or learning new skills for junior operators.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available