Journal
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS
Volume 18, Issue 8, Pages 2217-2228Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TITS.2017.2709462
Keywords
User association; online reinforcement learning; load balancing; vehicular networks
Categories
Funding
- National Natural Science Foundation of China [61602110, 61571331]
- Sailing Program [16YF1400200]
- Shanghai Science and Technology Innovation Action Plan Project [16511100900]
- National Science Foundation for Postdoctoral Scientists of China [2016M591575]
- Fok Ying-Tong Education Foundation for Young Teachers in the Higher Education Institutions of China [151066]
- Shuguang Program from Shanghai Education Development Foundation [14SG20]
- Fundamental Research Funds for the Central Universities [2232016D-30]
Ask authors/readers for more resources
Recently, a number of technologies have been developed to promote vehicular networks. When vehicles are associated with the heterogeneous base stations (e.g., macrocells, picocells, and femtocells), one of the most important problems is to make load balancing among these base stations. Different from common mobile networks, data traffic in vehicular networks can be observed having regularities in the spatial-temporal dimension due to the periodicity of urban traffic flow. By taking advantage of this feature, we propose an online reinforcement learning approach, called ORLA. It is a distributed user association algorithm for network load balancing in vehicular networks. Based on the historical association experiences, ORLA can obtain a good association solution through learning from the dynamic vehicular environment continually. In the long run, the real-time feedback and the regular traffic association patterns both help ORLA cope with the dynamics of network well. In experiments, we use QiangSheng taxi movement to evaluate the performance of ORLA. Our experiments verify that ORLA has higher quality load balancing compared with other popular association methods.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available