Journal
COMPUTER COMMUNICATIONS
Volume 194, Issue -, Pages 135-147Publisher
ELSEVIER
DOI: 10.1016/j.comcom.2022.07.014
Keywords
Reinforcement learning; Q-learning; Platooning; MEC; Application relocation; Application migration
Categories
Funding
- Spanish State Research Agency (AEI) [PID20 19-109805RB-I00/AEI/10.13039/501100011033]
- Italian Ministry for University and Research (MIUR) under the initiative Departments of Excellence [232/2016]
- Free University of Bozen-Bolzano under the SECEDA project
Ask authors/readers for more resources
This paper presents a controller for managing platooning of connected cars from the network edge, adapting to varying network conditions. It also proposes a Q-Learning algorithm to maintain low-latency connection in high mobility scenarios. The introduced scheme exhibits better compliance with vehicle speed and spacing targets compared to existing techniques.
Connected cars are becoming more common. With the development of multi-access edge computing (MEC) for low-latency applications, it will be possible to manage the cooperative adaptive cruise control (CACC, also known as platooning) of such vehicles from the edge of cellular networks. In this paper, we present a controller that manages platooning from the network edge by adapting to varying network conditions. We incorporate a mechanism in the controller that allows vehicles to switch to automated cruise control when delays exceed safety thresholds, and back to platooning when the delays are sufficiently low to support it. We also formulate the problem of maintaining a low-latency connection in the presence of high mobility through migration, and propose a Q-Learning algorithm to solve this problem. We finally propose an Asynchronous Shared Learning scheme that enables multiple migration agents to cooperate, in order to expedite the convergence of migration policies. Compared to state-of-the-art migration techniques, our scheme exhibits better compliance of vehicle speed and spacing values to preset targets, and ameliorates statistical dispersion.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available