Abstract
Most traffic flow control algorithms address switching cycle adaptation of traffic signals and lights. This work addresses traffic flow optimisation by self-organising micro-level control combining Reinforcement Learning and rule-based agents for action selection performing long-range navigation in urban environments, i.e., vehicles represented by agents adapt their decision making for re-routing based on local environmental sensors. Agent-based modelling and simulation is used to study emergence effects on urban city traffic flows. An unified agent programming model enables simulation and distributed data processing with possible incorporation of crowd sensing tasks used as an additional sensor data base. Results from an agent-based simulation of an artificial urban area show that the deployment of micro-level vehicle navigation control just by learned individual decision making and re-routing based on local environmental sensors can increase the efficiency of mobility in terms of path length and travelling time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
LeoMcCluskey, T., Kotsialos, A., Müller, J.P., Schumann, R., Rana, O., Klügel, F.: Autonomic Road Transport Support Systems. Springer, Berlin (2012)
Balaji, P.G., German, X., Srinivasan, D.: Urban traffic signal control using reinforcement learning agents. IET Intell. Transp. Syst. 4(3), 177–188 (2010)
Fayazi, S.A., Vahidi, A.: Crowdsourcing phase and timing of pre-timed traffic signals in presence of queues: algorithms and backend system architecture. IEEE Trans. Intell. Transp. Syst. 17(3), 881 (2016)
Bosse, S., Engel, U.: Real-time human-in-the-loop simulation with mobile agents, chat bots, and crowd sensing for smart cities. Sensors (MDPI) (2019). https://doi.org/10.3390/s19204356
Wan, J., Li, J., Shao, Z., Vasilakos, A.V., Imran, M., Zhou, K.: Mobile crowd sensing for traffic prediction in internet of vehicles. Sensors 16, 1–88 (2016)
Ferreira, M., Fernandes, R., Conceição, H., Viriyasitavat, W., Tonguz, O.K.: Self-organized traffic control. In: VANET 2010, Chicago, Illinois, 24 September 2010 (2010)
Płaczek, B.: A self-organizing system for urban traffic control based on predictive interval microscopic model. Eng. Appl. Artif. Intell. 34, 75–84 (2014)
Arel, I., Liu, C., Urbanik, T., Kohls, A.G.: Reinforcement learning-based multi-agent system for network traffic signal control. IET Intell. Transp. Syst. 4(2), 128–135 (2010)
Abdoos, M., Mozayani, N., Bazzan, A.L.C.: Traffic light control in non-stationary environments based on multi agent Q-learning. In: 14th International IEEE Conference on Intelligent Transportation Systems Washington, DC, USA, 5–7 October 2011 (2011)
Abdoos, M., Mozayani, N., Bazzan, A.L.C.: Hierarchical control of traffic signals using Q-learning with tile coding. Appl. Intell. 40(2), 201–213 (2013)
Brysa, T., Pham, T.T., Taylor, M.E.: Distributed learning and multi-objectivity in traffic light control. Connect. Sci. 26(1), 65–83 (2014)
Bosse, S.: Mobile multi-agent systems for the Internet-of-Things and clouds using the JavaScript agent machine platform and machine learning as a service. In: The IEEE 4th International Conference on Future Internet of Things and Cloud, Vienna, Austria, 22–24 August 2016 (2016). https://doi.org/10.1109/ficloud.2016.43
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Bosse, S. (2021). Self-organising Urban Traffic Control on Micro-level Using Reinforcement Learning and Agent-Based Modelling. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Systems and Applications. IntelliSys 2020. Advances in Intelligent Systems and Computing, vol 1251. Springer, Cham. https://doi.org/10.1007/978-3-030-55187-2_53
Download citation
DOI: https://doi.org/10.1007/978-3-030-55187-2_53
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-55186-5
Online ISBN: 978-3-030-55187-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)