A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

With the emergence of mobile edge computing (MEC), the edge cloud with certain computing power is deployed closer to the mobile device, which can well solve the computing and delay requirements of the mobile device. In 5G ultra-dense heterogeneous networks, where the macro base station (MBS) and multiple dense small base stations (SBS) are deployed in the region, the offloading decision faces multiple choices. In order to solve the problem of computing offloading and resource allocation in 5G ultra-dense heterogeneous networks, we propose a collaborative optimization strategy based on multi-agent deep reinforcement learning (MADRL). At each time, the mobile device only needs to make the optimal offloading decision according to its own historical offloading decision, the allocated bandwidth and computing resources at the past time, as well as the service response delay and energy consumption at the past time, without knowing other user information and dynamic network environment information. Simulation results show that the proposed collaborative optimization strategy is better than the other three baseline schemes in terms of service response delay and energy consumption performance.

Automated summary

With the emergence of mobile edge computing (MEC), the computing and delay requirements of mobile devices can be solved by deploying edge clouds closer to the devices. In dense 5G heterogeneous networks where macro base stations (MBS) and multiple small base stations (SBS) are deployed, the offloading decision needs to consider multiple choices. To address the problem of computing offloading and resource allocation, a collaborative optimization strategy based on multi-agent deep reinforcement learning (MADRL) is proposed. Simulation results demonstrate that this strategy outperforms other baseline schemes in terms of service response delay and energy consumption.