Journal
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING
Volume 6, Issue 1, Pages 408-421Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCCN.2019.2954396
Keywords
Heterogeneous networks; proactive resource allocation; mobility prediction; deep reinforcement learning; robustness
Categories
Funding
- National Science Foundation of China (NSFC) [61771065, 61631005, 61901048]
- Beijing Municipal Science and Technology Commission Research [Z181100003218015]
- Fundamental Research Funds for the Central Universities [500418765]
Ask authors/readers for more resources
Proactive resource allocation (PRA) is an essential technology boosting intelligent communication, as it can make full use of prediction and significantly improve network performance. However, most promising gains base on perfect prediction which is unrealistic. How to make PRA robust against prediction uncertainty and maximize benefits brought by prediction becomes an important issue. In this paper, we tackle this problem and propose a mobility-aware robust PRA approach (MRPRA) in heterogeneous networks. MRPRA pre-allocates resources in both time and frequency domains among mobile users with users' trajectories predicted by hidden Markov model. The objective is to minimize service delay under constraints of different levels of quality-of-service (QoS) requirement and mobility intensity. MRPRA is robust against prediction uncertainty by exploiting probabilistic constraint programming to model QoS requirements in a probabilistic sense. To this end, the probabilistic distribution of achievable rate is derived. To flexibly coordinate resource allocation among multiple mobile users over time horizon, a deep reinforcement learning based multi-actor deep deterministic policy gradient algorithm is designed. It learns robust PRA policies by distributed acting and centralized criticizing. Extensive numerical simulations are performed to analyze performances of the proposed approach.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available