Journal
SOFT COMPUTING
Volume 17, Issue 11, Pages 2089-2099Publisher
SPRINGER
DOI: 10.1007/s00500-013-1110-y
Keywords
Supervised reinforcement learning; Actor-Critic; Adaptive cruise control; Uniformly ultimate bounded; Neural networks
Categories
Funding
- National Natural Science Foundation of China [61273136, 61034002]
- Beijing Natural Science Foundation [4122083]
Ask authors/readers for more resources
A novel supervised Actor-Critic (SAC) approach for adaptive cruise control (ACC) problem is proposed in this paper. The key elements required by the SAC algorithm namely Actor and Critic, are approximated by feed-forward neural networks respectively. The output of Actor and the state are input to Critic to approximate the performance index function. A Lyapunov stability analysis approach has been presented to prove the uniformly ultimate bounded property of the estimation errors of the neural networks. Moreover, we use the supervisory controller to pre-train Actor to achieve a basic control policy, which can improve the training convergence and success rate. We apply this method to learn an approximate optimal control policy for the ACC problem. Experimental results in several driving scenarios demonstrate that the SAC algorithm performs well, so it is feasible and effective for the ACC problem.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available