Journal
2021 IEEE 93RD VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-SPRING)
Volume -, Issue -, Pages -Publisher
IEEE
DOI: 10.1109/VTC2021-Spring51267.2021.9448852
Keywords
Vehicular networks; network slicing; deep reinforcement learning; resource allocation
Categories
Funding
- Natural Science Foundation of China (NSFC) [61801065, 61771082, 61871062, 61901070]
- Science and Technology Research Program of Chongqing Municipal Education Commission [KJQN202000603, KJQN201900611]
- Natural Science Foundation of Chongqing [cstc2020jcyj-zdxmX0024]
- University Innovation Research Group of Chongqing [CXQT20017]
Ask authors/readers for more resources
In this paper, a two-timescale radio resource allocation scheme called LSTM-DDPG is proposed to provide stable service for vehicles in a dynamic vehicular environment. By utilizing LSTM and DDPG algorithms, resources are optimized in both long-term and short-term aspects to ensure stable performance for served vehicles within the resource scheduling interval.
Network slicing can support the diverse use cases with heterogeneous requirements, and has been considered as one of the key roles in future networks. However, as the dynamic traffic demands and the mobility in vehicular networks, how to perform RAN slicing efficiently to provide stable quality of service (QoS) for connected vehicles is still a challenge. In order to meet the diversified service request of vehicles in such a dynamic vehicular environment, in this paper, we propose a two-timescale radio resource allocation scheme, namely, LSTM-DDPG, to provide stable service for vehicles. Specifically, for the long-term dynamic characteristics of service request from vehicles, we use long short-term memory (LSTM) to follow the tracks, such that the dedicated resource allocation is executed in a long timescale by using historical data. On the other hand, for the impacts of channel changes caused by high-speed movement in a short period, a deep reinforcement learning (DRL) algorithm, i.e., deep deterministic policy gradient (DDPG), is leveraged to adjust the allocated resources. We prove the effectiveness of the proposed LSTM-DDPG with simulation results, the cumulative probability that the slice supplies a stable performance to the served vehicle within the resource scheduling interval can reach more than 90%. Compared with the conventional deep Q-networks (DQN), the average cumulative probability has increased by 27.8%.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available