期刊
SENSORS
卷 22, 期 18, 页码 -出版社
MDPI
DOI: 10.3390/s22186853
关键词
deep reinforcement learning (DRL); soft actor-critic (SAC); low earth orbit (LEO) satellite; graph attention network (GAT)
资金
- Future Combat System Network Technology Research Center program of Defense Acquisition Program Administration
- Agency for Defense Development [UD190033ED]
In this paper, a cooperative downloading scheme based on deep reinforcement learning is proposed to fully utilize satellite downloading capabilities by utilizing inter-satellite communication links. The proposed scheme can enhance the average utilization of contact time by up to 17.8% compared with independent downloading and randomly offloading schemes.
In low earth orbit (LEO) satellite-based applications (e.g., remote sensing and surveillance), it is important to efficiently transmit collected data to ground stations (GS). However, LEO satellites' high mobility and resultant insufficient time for downloading make this challenging. In this paper, we propose a deep-reinforcement-learning (DRL)-based cooperative downloading scheme, which utilizes inter-satellite communication links (ISLs) to fully utilize satellites' downloading capabilities. To this end, we formulate a Markov decision problem (MDP) with the objective to maximize the amount of downloaded data. To learn the optimal approach to the formulated problem, we adopt a soft-actor-critic (SAC)-based DRL algorithm in discretized action spaces. Moreover, we design a novel neural network consisting of a graph attention network (GAT) layer to extract latent features from the satellite network and parallel fully connected (FC) layers to control individual satellites of the network. Evaluation results demonstrate that the proposed DRL-based cooperative downloading scheme can enhance the average utilization of contact time by up to 17.8% compared with independent downloading and randomly offloading schemes.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据