Abstract
In order to alleviate traffic congestion for vehicles in urban networks, most of current researches mainly focused on signal optimization models and traffic assignment models, or tried to recognize the interaction between signal control and traffic assignment. However, these methods may not be able to provide fast and accurate route guidance due to the lack of individual traffic demands, real-time traffic data and dynamic cooperation between vehicles. To solve these problems, this paper proposes a dynamic and real-time route selection model in urban traffic networks (DR2SM), which can supply a more accurate and personalized strategy for vehicles in urban traffic networks. Combining the preference for alternative routes with real-time traffic conditions, each vehicle in urban traffic networks updates its route selection before going through each intersection. Based on its historical experiences and estimation about route choices of the other vehicles, each vehicle uses a self-adaptive learning algorithm to play congestion game with each other to reach Nash equilibrium. In the route selection process, each vehicle selects the user-optimal route, which can maximize the utility of each driving vehicle. The results of the experiments on both synthetic and real-world road networks show that compared with non-cooperative route selection algorithms and three state-of-the-art equilibrium algorithms, DR2SM can effectively reduce the average traveling time in the dynamic and uncertain urban traffic networks.






Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Adacher L, Cipriani E, Gemma A (2015) The global optimization of signal settings and traffic assignment combined problem: a comparison between algorithms. Adv Transp Stud 36:35–48
Adacher L, Oliva G, Pascucci F (2014) Decentralized route guidance architectures with user preferences in urban transportation networks. Procedia Soc Behav Sci 111:1054–1062
Benaïm M (2006) Dynamics of stochastic approximation algorithms. Séminaire De Probabilités XXXIII, vol 1709, pp 1–68
Cantarella GE, Velonà P, Vitetta A (2012) Signal setting with demand assignment: global optimization with day-to-day dynamic stability constraints. J Adv Transp 46(3):254–268
Chapman AC, Leslie DS, Rogers A et al (2013) Convergent learning algorithms for unknown reward games. SIAM J Control Optim 51(4):3154–3180
Chen LW, Hu TY (2012) Flow equilibrium under dynamic traffic assignment and signal control-an illustration of pretimed and actuated signal control policies. IEEE Trans Intell Transp Syst 13(3):1266–1276
Chim TW, Yiu SM, Hui LCK et al (2014) VSPN: VANET-based secure and privacy-preserving navigation. IEEE Trans Comput 63(2):510–524
Chongwhite C, Millar G, Aydos JC (2014) Scenarios demonstrating congestion management policies using SCATS: Stage 2. In: ARRB Conference, 26th, 2014, Sydney, New South Wales, Australia
Desai P, Loke SW, Desai A et al (2013) CARAVAN: congestion avoidance and route allocation using virtual agent negotiation. IEEE Trans Intell Transp Syst 14(3):1197–1207
Dijkstra EW (1959) A note on two problems in connexion with graphs. Numer Math 1(1):269–271
Fernando O, Nicolas ES (2010) Wardrop equilibria with risk-averse users. Transp Sci 44(1):63–86
Fudenberg BD, Levine DK (2015) The theory of learning in games, ser. http://ideas.repec.org/b/mtp/titles/0262061945.html
Groot N, De Schutter B, Hellendoorn H (2015) Toward system-optimal routing in traffic networks: a reverse stackelberg game approach. IEEE Trans Intell Transp Syst 16(1):29–40
Han K, Friesz TL, Yao T (2013) Existence of simultaneous route and departure choice dynamic user equilibrium. Transp Res Part B Methodol 53(3):17–30
Hart PE, Nilsson NJ, Raphael B (1968) A formal basis for the heuristic determination of minimum cost paths. IEEE Trans Syst Sci Cybernet 4(2):100–107
Hu W, Wang H, Yan L (2014) An actual urban traffic simulation model for predicting and avoiding traffic congestion. In: 2014 IEEE 17th international conference on intelligent transportation systems (ITSC). IEEE
Hu W, Yan L, Liu K et al (2016) A short-term traffic flow forecasting method based on the hybrid PSO-SVR. Neural Process Lett 43(1):155–172
Hu W, Yan L, Wang H et al (2015) On exploring a virtual agent negotiation inspired approach for route guidance in urban traffic networks. In: IEEE, international conference on algorithms and architectures for parallel processing. IEEE, pp 3–16
Jimbo T, Fujinami K (2015) Detecting mischoice of public transportation route based on smartphone and GIS. In: 2015 ACM international joint conference on pervasive and ubiquitous computing (UbiComp 2015), pp 165–168
Kaur T, Agrawal S (2014) Adaptive traffic lights based on hybrid of neural network and genetic algorithm for reduced traffic congestion. In: 2014 recent advances in engineering and computational sciences (RAECS), pp 1–5
Lee WH, Tseng SS, Shieh WY (2010) Collaborative real-time traffic information generation and sharing framework for the intelligent transportation system. Inf Sci 180(1):62–70
Li T, Zhang J, Wang S et al (2014) Research on route planning based on quantum-behaved particle swam optimization algorithm. In: Guidance, navigation and control conference (CGNCC), 2014 IEEE Chinese. IEEE, pp 335–339
Lin J, Yu W, Yang X et al (2015) A novel dynamic en-route decision real-time route guidance scheme in intelligent transportation systems. In: IEEE, international conference on distributed computing systems. IEEE, pp 61–72
Liu YW, Zhang HB (2012) Research and application of countdown traffic signal lamps based on SCOOT traffic control system. Transportation Standardization
Lujak M, Giordani S, Ossowski S (2015) Route guidance: bridging system and user optimization in traffic assignment. Neurocomputing 151:449–460
Mao Y, Zhang D, Chen N et al (2012) Dynamic route guidance system based on mixed genetic algorithm. Sci Mosaic 11:6–9
Miyagi T, Peque G, Fukumoto J (2013) Adaptive learning algorithms for traffic games with naive users. Procedia Soc Behav Sci 80:806–817
Pan J, Popa IS, Borcea C (2017) DIVERT: a distributed vehicular traffic re-routing system for congestion avoidance. IEEE Trans Mob Comput 16(1):58–72
Rodríguez M, Blesa F, Barrio R (2015) OpenCL parallel integration of ordinary differential equations: applications in computational dynamics. Comput Phys Commun 192(9):228–236
Samadi P, Mohsenian-Rad H, Wong VWS et al (2014) Real-time pricing for demand response based on stochastic approximation. IEEE Trans Smart Grid 5(2):789–798
Schrank D, Eisele B, Lomax T (2012) 2012 urban mobility report. Texas A & M University, College Station
Shamma JS (2015) Learning in Games. Encycl Syst Control 133(1):177–198
Taale H, Van ZHJ (2001) The combined traffic assignment and control problem—an overview of 25 years of research. In: Selected proceedings of the, world conference on transport research
Wang L, Jiang P, Zhong J et al (2014) Intelligent traffic guidance system based on dynamic toll collection policy. In: 2014 fourth international conference on communication systems and network technologies (CSNT). IEEE, pp 1172–1176
Yamada K, Ma J, Fukuda D (2013) Simulation analysis of the market diffusion effects of risk-averse route guidance on network traffic. Procedia Comput Sci 19:874–881
Yu L, Li M, Yang Y et al (2015) An improved ant colony optimization for vehicle routing problem. In: Logistics@sThe emerging frontiers of transportation and development in China. ASCE, pp 3360–3366
Yu S, Shingo M, Kanta MM et al (2013) An application of Q-value-based dynamic programming with Boltzmann distribution to real-world road networks. IEEE Trans Electr Electron Eng 8(2):139–145
Zaidi AA, Kulcsár B, Wymeersch H (2016) Back-pressure traffic signal control with fixed and adaptive routing for urban vehicular networks. IEEE Trans Intell Transp Syst 17(8):2134–2143
Acknowledgements
This work is partially supported by National Natural Science Foundation of China (61572369, 61711530238); National Natural Science Foundation of Hubei Province (2015CFB423); Wuhan Major Science and Technology Program (2015010101010023); Science and Technology Project of Jiangxi Provincial Education Department (GJJ160494, GJJ160500) and Jiangxi Province Youth Science Foundation (20151BAB217017). The authors also gratefully acknowledge the helpful comments and suggestions of the reviewers, which have improved the presentation.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yan, L., Hu, W. & Hu, S. SALA: A Self-Adaptive Learning Algorithm—Towards Efficient Dynamic Route Guidance in Urban Traffic Networks. Neural Process Lett 50, 77–101 (2019). https://doi.org/10.1007/s11063-018-9870-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-018-9870-0