期刊
OCEAN ENGINEERING
卷 286, 期 -, 页码 -出版社
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.oceaneng.2023.115577
关键词
Deep reinforcement learning; Hierarchical reinforcement learning; Artificial potential field; Formation control; Unmanned surface vehicles
This paper proposes a novel multi-USV formation path planning algorithm based on deep reinforcement learning. The algorithm utilizes goal-based hierarchical reinforcement learning and an improved artificial potential field algorithm to address training speed and planning conflicts, achieving optimal path planning and obstacle avoidance through a formation geometry model and a composite reward function.
In this paper, a novel multi-USV formation path planning algorithm is proposed based on deep reinforcement learning. First, a goal-based hierarchical reinforcement learning algorithm is designed to improve training speed and resolve planning conflicts within the formation. Second, an improved artificial potential field algorithm is designed in the training process to obtain the optimal path planning and obstacle avoidance learning scheme for multi-USVs in the determined perceptual environment. Finally, a formation geometry model is established to describe the physical relationships among USVs, and a composite reward function is proposed to guide the training. Numerous simulation tests are conducted, and the effectiveness of the proposed algorithm are further validated through the NEU-MSV01 experimental platform with a combination of parameterized Line of Sight (LOS) guidance.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据