4.7 Article

Deep reinforcement learning for computation offloading in mobile edge computing environment

期刊

COMPUTER COMMUNICATIONS
卷 175, 期 -, 页码 1-12

出版社

ELSEVIER
DOI: 10.1016/j.comcom.2021.04.028

关键词

Internet of things (IoT); Reinforcement learning; Markov decision process; Computation offloading; Deep learning; Mobile edge computing

资金

  1. National Natural Science Foundation of China [61772554, 62072475]

向作者/读者索取更多资源

This paper proposes a learning-based mobile fog scheme with deep deterministic policy gradient algorithm to improve the fog resource provisioning performance of mobile devices. The scheme models offloading computing as Markov Decision Processes, realizing offloading among different network states without knowing the transition probabilities, and uses the DDPG algorithm to address the state spaces explosion issue and learn an optimal offloading policy on distributed mobile fog computing. Simulation results show significant improvement in performance compared to traditional methods.
Recently, in order to distribute computing, networking resources, services, near terminals, mobile fog is gradually becoming the mobile edge computing (MEC) paradigm. In a mobile fog environment, the quality of service affected by offloading speeds and the fog processing, however the traditional fog method to solve the problem of computation resources allocation is difficult because of the complex network states distribution environment (that is, F-AP states, AP states, mobile device states and code block states). In this paper, to improve the fog resource provisioning performance of mobile devices, the learning-based mobile fog scheme with deep deterministic policy gradient (DDPG) algorithm is proposed. An offloading block pulsating discrete event system is modeled as a Markov Decision Processes (MDPs), which can realize the offloading computing without knowing the transition probabilities among different network states. Furthermore, the DDPG algorithm is used to solve the issue of state spaces explosion and learn an optimal offloading policy on distributed mobile fog computing. The simulation results show that our proposed scheme achieves 20%, 37%, 46% improvement on related performance compared with the policy gradient (PG), deterministic policy gradient (DPG) and actor- critic (AC) methods. Besides, compared with the traditional fog provisioning scheme, our scheme shows better cost performance of fog resource provisioning under different locations number and different task arrival rates.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据