Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3551663.3558686acmconferencesArticle/Chapter ViewAbstractPublication PagesmswimConference Proceedingsconference-collections
research-article

Privacy-Aware Vehicle Emissions Control System for Traffic Light Intersections

Published: 24 October 2022 Publication History

Abstract

This paper proposes a privacy-aware reinforcement learning (RL) framework to reduce carbon emissions of vehicles approaching light traffic intersections. Taking advantage of vehicular communications, traffic lights disseminate their state (i.e., traffic light cycle) among vehicles in their proximity. Then, the RL model is trained using public traffic lights data while preserving private car information locally (i.e., at the vehicle premises). Vehicles act as the agents of the model, and traffic infrastructure serves as the environment where the agent lives. Each time, the RL model decides if the vehicle should accelerate or decelerate (i.e., the model action) based on received traffic light observations. The optimal RL model strategy, dictating vehicles' driving speed, is learned following the proximal policy optimization algorithm. Results show that by moderating vehicles' speed when approximating traffic light intersections, gas emissions are reduced by 25% CO2 and 38% NOx emissions. The same happens for EVs that reduce energy consumption by 20W/h compared to not using the model. at intersections. The final impact of using the model refers to a negligible increment of 20s in the trip duration.

References

[1]
2020. 2020 KIA Soul EV 64 kWh - Specifications and price. https://www.evspecifications.com/en/model/e94fa0
[2]
2021. Sumolib - SUMO Documentation. https://sumo.dlr.de/docs/Tools/Sumolib.html
[3]
Pablo Barbecho Bautista, Leticia Lemus Cárdenas, Luis Urquiza Aguiar, and Mónica Aguilar Igartua. 2019. A traffic-aware electric vehicle charging management system for smart cities. Vehicular Communications 20 (2019), 100188. https://doi.org/10.1016/j.vehcom.2019.100188
[4]
Laura Bieker-Walz and Michael Behrisch. 2019. Modelling green waves for emergency vehicles using connected traffic data. In SUMO User Conference 2019 (EPiC Series in Computing, Vol. 62), Melanie Weber, Laura Bieker-Walz, Robert Hilbrich, and Michael Behrisch (Eds.). EasyChair, 10--20. https://doi.org/10.29007/sj1m
[5]
Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. OpenAI Gym. arXiv:arXiv:1606.01540
[6]
Xavier Calle Heredia, Pablo Barbecho Bautista, and Mónica Aguilar Igartua. 2021. Performance Evaluation of Cooperative LTE-DSRC Vehicular Network. Association for Computing Machinery, New York, NY, USA, 25--32. https://doi.org/10.1145/3479240.3488528
[7]
Prafulla Dhariwal, Christopher Hesse, Oleg Klimov, Alex Nichol, Matthias Plappert, Alec Radford, John Schulman, Szymon Sidor, Yuhuai Wu, and Peter Zhokhov. 2017. OpenAI Baselines. https://github.com/openai/baselines.
[8]
Chang Guo, Demin Li, Guanglin Zhang, and Menglin Zhai. 2018. Real-Time Path Planning in Urban Area via VANET-Assisted Traffic Information Sharing. IEEE Transactions on Vehicular Technology 67, 7 (2018), 5635--5649. https://doi.org/10.1109/TVT.2018.2806979
[9]
Wenwen Kang, Gang Xiong, Yisheng Lv, Xisong Dong, Fenghua Zhu, and Qingjie Kong. 2014. Traffic signal coordination for emergency vehicles. In 17th International IEEE Conference on Intelligent Transportation Systems (ITSC). 157--161. https://doi.org/10.1109/ITSC.2014.6957683
[10]
Mohamed A. Khamis and Walid Gomaa. 2014. Adaptive multi-objective reinforcement learning with hybrid exploration for traffic signal control based on cooperative multi-agent framework. Engineering Applications of Artificial Intelligence 29 (2014), 134--151. https://doi.org/10.1016/j.engappai.2014.01.007
[11]
Daniel Krajzewicz, Michael Behrisch, Peter Wagner, Raphael Luz, and Mario Krumnow. 2015. Second Generation of Pollutant Emission Models for SUMO. In Modeling Mobility with Open Data (Lecture Notes in Mobility), Michael Behrisch and Melanie Weber (Eds.). Springer International Publishing, Cham, 203--221. https://doi.org/10.1007/978--3--319--15024--6_12
[12]
Tamás Kurczveil, Pablo Álvarez López, and Eckehard Schnieder. 2014. Implementation of an Energy Model and a Charging Infrastructure in SUMO. In Simulation of Urban Mobility, Michael Behrisch, Daniel Krajzewicz, and Melanie Weber (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 33--43.
[13]
Pablo Alvarez Lopez, Michael Behrisch, Laura Bieker-Walz, Jakob Erdmann, Yun-Pang Flötteröd, Robert Hilbrich, Leonhard Lücken, Johannes Rummel, Peter Wagner, and Evamarie Wießner. 2018. Microscopic Traffic Simulation using SUMO, In The 21st IEEE International Conference on Intelligent Transportation Systems. 2005 IEEE Intelligent Transportation Systems Conference (ITSC). https://elib.dlr.de/124092/
[14]
Stefano Luzzatto. 2006. Chapter 3 - Stochastic-Like Behaviour in Nonuniformly Expanding Maps. In Handbook of Dynamical Systems, B. Hasselblatt and A. Katok (Eds.). Handbook of Dynamical Systems, Vol. 1. Elsevier Science, 265--326. https://doi.org/10.1016/S1874--575X(06)80028--7
[15]
Wanli Min, Liang Yu, Peng Chen, Maolei Zhang, Yu Liu, and Jiawei Wang. 2020. On-Demand Greenwave for Emergency Vehicles in a Time-Varying Road Network With Uncertainties. IEEE Transactions on Intelligent Transportation Systems 21, 7 (2020), 3056--3068. https://doi.org/10.1109/TITS.2019.2923802
[16]
John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal Policy Optimization Algorithms. arXiv:1707.06347 [cs.LG]
[17]
Mahboubeh Shamsi, Abdolreza Rasouli Kenari, and Roghayeh Aghamohammadi. 2021. Reinforcement learning for traffic light control with emphasis on emergency vehicles. The Journal of Supercomputing (2021). https://doi.org/10.1007/s11227-021-04068-w
[18]
Christoph Sommer, David Eckhoff, Reinhard German, and Falko Dressler. 2011. A computationally inexpensive empirical model of IEEE 802.11p radio shadowing in urban environments. 2011 8th Int. Conf. on Wireless On-Demand Network Systems and Services (2011), 84--90. https://doi.org/10.1109/WONS.2011.5720204
[19]
Christoph Sommer, Reinhard German, and Falko Dressler. 2011. Bidirectionally Coupled Network and Road Traffic Simulation for Improved IVC Analysis. IEEE Transactions on Mobile Computing (TMC) 10, 1 (January 2011), 3--15. https://doi.org/10.1109/TMC.2010.133
[20]
Jie Song, Yi Wu, Zhexin Xu, and Xiao Lin. 2015. Research on car-following model based on SUMO. In Proceedings of 2014 IEEE 7th Int. Conf. on Advanced Infocomm Technology, IEEE/ICAIT 2014. 47--55. https://doi.org/10.1109/ICAIT.2014.7019528
[21]
Dr B Vahedha. 2013. Smart Traffic Control System for Clearance to Emergency Vehicles Using Arduino Software. Electron. Eng 2, 3 (2013), 102--107.
[22]
Andras Varga. 2010. OMNeT BT - Modeling and Tools for Network Simulation. Springer Berlin Heidelberg, Berlin, Heidelberg, 35--59. https://doi.org/10.1007/978--3--642--12331--3{_}3
[23]
Heng Wei, Chao He, Jiaqiang Li, and Longqing Zhao. 2022. Online estimation of driving range for battery electric vehicles based on SOC-segmented actual driving cycle. Journal of Energy Storage 49 (2022), 104091. https://doi.org/10.1016/j.est.2022.104091
[24]
Hanyu Zhu, Zixin Wang, Fuqian Yang, Yong Zhou, and Xiliang Luo. 2021. Intelligent Traffic Network Control in the Era of Internet of Vehicles. IEEE Transactions on Vehicular Technology 70, 10 (2021), 9787--9802. https://doi.org/10.1109/TVT.2021.3105478

Cited By

View all
  • (2024)Fusion of deep belief network and SVM regression for intelligence of urban traffic control systemThe Journal of Supercomputing10.1007/s11227-024-06386-1Online publication date: 13-Aug-2024

Index Terms

  1. Privacy-Aware Vehicle Emissions Control System for Traffic Light Intersections

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      PE-WASUN '22: Proceedings of the 19th ACM International Symposium on Performance Evaluation of Wireless Ad Hoc, Sensor, & Ubiquitous Networks
      October 2022
      148 pages
      ISBN:9781450394833
      DOI:10.1145/3551663
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 24 October 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. ITSs
      2. reinforcement learning paradigm
      3. vehicular networks

      Qualifiers

      • Research-article

      Funding Sources

      • Spanish Government

      Conference

      MSWiM '22
      Sponsor:

      Acceptance Rates

      PE-WASUN '22 Paper Acceptance Rate 17 of 60 submissions, 28%;
      Overall Acceptance Rate 70 of 240 submissions, 29%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)10
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 13 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Fusion of deep belief network and SVM regression for intelligence of urban traffic control systemThe Journal of Supercomputing10.1007/s11227-024-06386-1Online publication date: 13-Aug-2024

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media