4.7 Article

A Hybrid DQN and Optimization Approach for Strategy and Resource Allocation in MEC Networks

Journal

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS
Volume 20, Issue 7, Pages 4282-4295

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TWC.2021.3057882

Keywords

Task analysis; Resource management; Servers; Optimization; Minimization; Energy consumption; Cloud computing; Energy consumption; deep Q network; latency; mobile edge computing; non-convex optimization; offloading; resource allocation

Funding

  1. Ministry of Science and Technology, Taiwan [MOST107-2221-E-002-196-MY3]
  2. MOE ARF Tier 2 [T2EP20120-0006]
  3. SUTD Growth Plan Grant

Ask authors/readers for more resources

This study proposes two hybrid approaches to tackle the offloading decision and resource allocation problem in a multi-user multi-server mobile edge computing network, optimizing at user equipment and computational access point, simulation results show that the hybrid approaches outperform baseline algorithms and pure-DQN approach significantly.
We consider a multi-user multi-server mobile edge computing (MEC) network with time-varying fading channels and formulate an offloading decision and resource allocation problem. To solve this mixed-integer non-convex problem, we propose two hybrid approaches that learn offloading strategy with DQN (opt-DQN) or Q-table (opt-QL) at each user equipment (UE). The communication resources are allocated with an optimization algorithm at each computational access point (CAP). We also propose a pure DQN method that learns both the offloading strategy and resource allocation via Q-learning (QL). We analyze the convergence behavior of the QL-based algorithms from a game-theoretical perspective and demonstrate the performance of the proposed hybrid approaches for different network sizes. The simulation results show that the hybrid approaches reach lower costs than other baseline algorithms and the pure-DQN approach. Moreover, the performance of the pure-DQN approach degrades severely as the network size increases, while opt-DQN still performs the best, followed by opt-QL. These observations demonstrate that the hybrid approach that combines the advantages of both QL and convex optimization is a promising design for a multi-user MEC network, wherein complicated offloading and resource allocation strategies need to be determined in a timely and accurate fashion.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available