Journal
2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM)
Volume -, Issue -, Pages -Publisher
IEEE
DOI: 10.1109/GLOBECOM46510.2021.9685323
Keywords
AUV; target tracking; multi-agent reinforcement learning; information system security
Categories
Funding
- National Natural Science Foundation China [61971257]
- National Key R&D Program of China [2020YFD0901000]
- Young Elite Scientist Sponsorship Program by CAST [2020QNRC001]
Ask authors/readers for more resources
This paper proposes a novel cooperative tracking scheme performed by an intelligent AUV swarm towards an underwater moving target, ensuring the security of the entire system.
The autonomous underwater vehicle (AUV) has gradually become an important platform for performing various underwater tasks. Due to the shortcomings resulting from a single AUV's poor detection, information processing and moving capabilities, more and more tasks are completed in a cooperative manner by multiple AUVs. However, most of the existing works do not consider security factors in the process of multi-AUV cooperation. In this paper, we propose a novel cooperative tracking scheme towards an underwater moving target, performed by an intelligent AUV swarm. In this scheme, a cooperative multi-agent reinforcement learning (MARL) based tracking algorithm is proposed following a centralized training with distributed execution (CT-DE) manner. After centralized training in the designed secure private network, no information sharing is required during the mission execution. This feature ensures the security of the whole system, especially in a complex confrontation scenario. In addition, we build models of the AUV underwater dynamics and the target sonar detection, which make the algorithm applicable to real target tracking enabled AUV swarms. Then, based on the multi-agent deep deterministic policy gradient (MADDPG) algorithm, we design an end-to-end AUV control algorithm. Simulation results validate that the proposed algorithm can achieve competitive performance in tracking success rate and tracking stability against baselines, while ensuring the security of the entire system.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available