Journal
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS
Volume 17, Issue 12, Pages 7968-7979Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TII.2021.3059676
Keywords
Traffic control; Industries; Production; Adaptation models; Decision making; Task analysis; Robots; Automated guided vehicle (AGV); behavior trees (BTs); Industrial 4; 0; reinforcement learning (RL); self-adaptive control
Categories
Funding
- National Science Foundation of China [52075452]
Ask authors/readers for more resources
By combining behavior trees and reinforcement learning, a self-adaptive traffic control model has been proposed to make optimal decisions for AGV systems in smart manufacturing. The study shows that AGVs can adaptively choose the optimal rule-based strategy, enhancing traffic control capability while ensuring efficiency, timeliness, and safety.
Automated guided vehicles (AGVs) are considered as an enabling technology to realize smart manufacturing in the upcoming Industrial 4.0 era. However, several challenges including efficiency, timeliness, and safety still exist in AGVs system in discrete manufacturing shopfloor. To address these challenges, a self-adaptive traffic control model combining behavior trees (BTs) and reinforcement learning (RL) is proposed to implement optimal decisions according to diverse, dynamic and complex situations in Industry 4.0 environments. A cyber-physical systems using multiagent system technology is designed in which components such as AGVs and traffic commander are defined as specific agent that cooperates autonomously with each other. Then, the behavior construction model is constructed by BTs to enumerate all the possible states in AGVs traffic control. An RL model is further developed based on the BTs. By using this approach, in this article, AGVs have the ability to adaptively choose the optimal rule-based strategy from existing optional strategies. The case study of the scenario avoiding collisions at intersections illustrates that the proposed model can enhance self-adaptive capability of AGVs traffic control and simultaneously guarantees efficiency, timeliness, and safety.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available