Journal
JOURNAL OF MANUFACTURING SYSTEMS
Volume 55, Issue -, Pages 325-333Publisher
ELSEVIER SCI LTD
DOI: 10.1016/j.jmsy.2020.04.018
Keywords
Assembly action recognition; Assembly monitoring; Deep learning; Object detection; Pose estimation
Categories
Funding
- National Key Research and Development Program of China [2018YFB1701302]
- Key Research and Development programs of Shandong Province [2017GGX203003]
Ask authors/readers for more resources
The present study employs deep learning methods to recognize repetitive assembly actions and estimate their operating times. It is intended to monitor the assembly process of workers and prevent assembly quality problems caused by the lack of key operational steps and the irregular operation of workers. Based on the characteristics of the repeatability and tool dependence of the assembly action, the recognition of the assembly action is considered as the tool object detection in the present study. Moreover, the YOLOv3 algorithm is initially applied to locate and judge the assembly tools and recognize the worker's assembly action. The present study shows that the accuracy of the action recognition is 92.8 %. Then, the pose estimation algorithm CPM based on deep learning is used to realize the recognition of human joint. Finally, the joint coordinates are extracted to judge the operating times of repetitive assembly actions. The accuracy rate of judging the operating times for repetitive assembly actions is 82.1 %.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available