期刊
IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY
卷 2, 期 -, 页码 272-288出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/OJVT.2021.3089083
关键词
Autonomous vehicular networks; computing task offloading; RAN slicing; resource sharing; task scheduling; cooperative multi-agent deep Q-learning; learning-assisted hierarchical approach; diverse QoS provisioning
This paper investigates a two-timescale radio access network (RAN) slicing and computing task offloading problem for a cloud-enabled autonomous vehicular network (C-AVN). The problem is addressed by formulating a stochastic optimization program for small timescale network dynamics, and employing cooperative multi-agent deep Q-learning (MA-DQL) for stabilization convergence. Through extensive simulation results, the proposed framework demonstrates effectiveness in maximizing communication and computing resource utilization.
In this paper, a two-timescale radio access network (RAN) slicing and computing task offloading problem is investigated for a cloud-enabled autonomous vehicular network (C-AVN). We aim at jointly maximizing the communication and computing resource utilization with diverse quality-of-service (QoS) guarantee for autonomous driving tasks. Specifically, to capture the small-timescale network dynamics, a computing task scheduling problem is formulated as a stochastic optimization program, for maximizing the long-term network-wide computation load balancing with minimum task offloading variations. Due to the large problem size and unavailable network state transition probabilities, we employ cooperative multi-agent deep Q-learning (MA-DQL) with fingerprint to solve the problem by learning the set of stationary task offloading policies with stabilized convergence. Given the task offloading decisions, we further study a RAN slicing problem in a large timescale, which is formulated as a convex optimization program. We focus on optimizing the radio resource slicing ratios among base stations, to maximize the aggregate network utility with statistical QoS provisioning for autonomous driving tasks. Based on the impact of radio resource slicing on computation load balancing, we propose a two-timescale hierarchical optimization framework to maximize both communication and computing resource utilization. Extensive simulation results are provided to demonstrate the effectiveness of the proposed framework in comparison with state-of-the-art schemes.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据