期刊
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY
卷 70, 期 12, 页码 13129-13138出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TVT.2021.3117536
关键词
Age-of-information (AoI); deep reinforcement learning (DRL); mobile data gathering centres; underwater linear networks
资金
- Memorial University's Research Chair
- Natural Sciences and Engineering Research Council of Canada (NSERC) though its Discovery program
- U.S. National Science Foundation [CCF-1908308]
This paper discusses the data collection by an AUV in an underwater linear network, proposing an optimization framework based on the age of information and utilizing deep reinforcement learning to solve non-convex mixed integer problems. Simulation results demonstrate the robustness and superior performance of the framework in various scenarios.
In this paper, we consider an underwater linear network, where an autonomous underwater vehicle (AUV) gathers data from a set of underwater devices. The AUV monitors a set of physical processes, where the status of each process can be sensed by one or more devices and each device is capable of sensing one or more processes. The AUV needs to maintain freshness of its information status about the monitored processes. To quantify the freshness of the information at the AUV, we consider the concept of the age of information (AoI), which represents the amount of time elapsed since the most recently delivered update information was generated. A framework is proposed to optimize the AUV's linear movement trajectory and scheduling of process status updates with the objective of minimizing the normalized weighted sum of the average AoI of the monitored physical processes. The formulated optimization problem is a non-convex mixed integer problem, which cannot be solved by the standard optimization techniques. We develop a solution approach based on the technique of deep reinforcement learning (DRL). Specifically, we leverage an actor-critic DRL approach to find the optimum locations and stopping time of the data gathering points. Simulation results illustrate that the proposed framework maintains robustness under different scenarios and provides better performance when compared with baseline and K-means clustering approaches.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据