Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

Real-time traffic light violations using distributed streaming

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Vehicles controlled by intelligent technologies, whose goal is to reduce human error and ease congestion, do not solely rely on human resources. Cities worldwide use camera systems to monitor the traffic, which collects the images and processes them through different computer vision algorithms. It is challenging for traffic monitoring systems to maintain their accuracy during the day and night lighting conditions, camera location relative to objects, video quality, traffic light position relative to the crossing line, and object angle from the surveillance camera. In this paper, we propose an improved traffic light violation detection method that concurrently streams videos through Apache Kafka and processes them with Apache Spark. It continues to operate for long periods without human intervention and adjusts automatically to changes in the environment. The violation detection algorithm utilizes a modified YOLOv5 and Hough space to efficiently capture the violation. YOLOv5 is a lightweight, fast, and efficient algorithm for real-time object detection. The improved YOLOv5 retrieves the object coordinates relative to the traffic lights, and Hough space analysis is employed to determine the violation region during the red traffic light. Hough space considers the object’s location and angle relative to the traffic lights. The model performs well in various situations of the input video datasets, as validated by performance metrics. The outcomes of extensive experiments show that the approach is well suited for deployment in real-time traffic violation detections. The outcomes are compared to a number of performance measures for object identification and traffic violations. In terms of traffic light violations, the model had 88.24% accuracy. The model is scalable enough, and it can deal effectively with real-world traffic video data at large scales.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

The datasets analyzed during the current study are available at [46].

References

  1. Traveled FOVM spring—policy, federal highway administration. https://www.fhwa.dot.gov/policyinformation/tables/vmt/vmt_forecast_sum.cfm

  2. Road Accidents in India, Ministry of Road Transport and Highways, Government of India. Government of India, Highways. https://morth.nic.in/sites/default/files/RA_Uploading.pdf

  3. Forecasts of vehicle miles traveled, spring 2021—policy, federal highway administration. https://www.fhwa.dot.gov

  4. Williams S, Davis S, Boundy R (2018) Transportation energy data book: edition 36.2 (no. ornl/tm-2017/513). In: Oak Ridge National Lab (ORNL), Oak Ridge, TN (United States)

  5. Liu Z, Zhang R, Wang C, Xiao Z, Jiang H (2022) Spatial-temporal conv-sequence learning with accident encoding for traffic flow prediction. IEEE Trans Netw Sci Eng

  6. Zhang X, Zhao Y, Min G, Miao W, Huang H, Ma Z (2022) Intelligent video ingestion for real-time traffic monitoring. ACM Trans Sens Netw (TOSN)

  7. Girshick R (2015) Fast R-CNN. arXiv:1504.08083

  8. Girshick RB, Donahue J, Darrell T, Malik J (2016) Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans Pattern Anal Mach Intell 38:142–158

    Article  Google Scholar 

  9. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 779–788. https://doi.org/10.1109/CVPR.2016.91

  10. Gaidash V, Grakovski A (2016) “Mass centre’’ vectorization algorithm for vehicle’s counting portable video system. Transp Telecommun 17(4):289

    Google Scholar 

  11. Thein KMM (2014) Apache kafka: next generation distributed messaging system. Int J Sci Eng Technol Res 3(47):9478–9483

    Google Scholar 

  12. Penchikala S (2018) Spark streaming. In: Big data processing with apache spark. C4 Media, InfoQ.com, pp 27–42

  13. Ki Y-K, Lee D-Y (2007) A traffic accident recording and reporting model at intersections. IEEE Trans Intell Transp Syst 8(2):188–194

    Article  Google Scholar 

  14. Kanhere NK, Birchfield ST (2008) Real-time incremental segmentation and tracking of vehicles at low camera angles using stable features. IEEE Trans Intell Transp Syst 9(1):148–160

    Article  Google Scholar 

  15. Song H-S, Lu S-N, Ma X, Yang Y, Liu X-Q, Zhang P (2014) Vehicle behavior analysis using target motion trajectories. IEEE Trans Veh Technol 63(8):3580–3591

    Article  Google Scholar 

  16. Wonghabut P, Kumphong J, Ung-arunyawee R, Leelapatra W, Satiennam T (2018) Traffic light color identification for automatic traffic light violation detection system. In: 2018 International Conference on Engineering, Applied Sciences, and Technology (ICEAST). IEEE, pp 1–4

  17. De La Cruz-Muciño D, Villarreal-Cervantes MG, Portilla-Flores EA (2013) Proceedings-2013 International Conference on Mechatronics, Electronics and Automotive Engineering, ICMEAE 2013

  18. Zaheri D, Abbas M (2015) An algorithm for identifying red light runners from radar trajectory data. In: 2015 IEEE 18th International Conference on Intelligent Transportation Systems. IEEE, pp 2683–2687

  19. Wang X, Meng L-M, Zhang B, Lu J, Du K-L (2013) A video-based traffic violation detection system. In: Proceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC), pp 1191–1194. https://doi.org/10.1109/MEC.2013.6885246

  20. Lin C-P, Tai J-C, Song K-T (2003) Traffic monitoring based on real-time image tracking. In: 2003 IEEE International Conference on Robotics and Automation (Cat. No. 03CH37422), vol 2. IEEE, pp 2091–2096

  21. Veeraraghavan H, Masoud O, Papanikolopoulos NP (2003) Computer vision algorithms for intersection monitoring. IEEE Trans Intell Transp Syst 4(2):78–89

    Article  Google Scholar 

  22. Aköz Ö, Karsligil ME (2014) Traffic event classification at intersections based on the severity of abnormality. Mach Vis Appl 25(3):613–632

    Article  Google Scholar 

  23. Hu W, Xiao X, Xie D, Tan T, Maybank S (2004) Traffic accident prediction using 3-d model-based vehicle tracking. IEEE Trans Veh Technol 53(3):677–694

    Article  Google Scholar 

  24. Wojke N, Bewley A, Paulus D (2017) Simple online and realtime tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP). IEEE, pp 3645–3649

  25. Xu R, Chen Y, Chen X, Chen S (2021) Deep learning based vehicle violation detection system. In: 2021 6th International Conference on Intelligent Computing and Signal Processing (ICSP). IEEE, pp 796–799

  26. Perafan-Villota JC, Mondragon OH, Mayor-Toro WM (2021) Fast and precise: parallel processing of vehicle traffic videos using big data analytics. IEEE Trans Intell Transp Syst

  27. Franklin RJ, Mohana (2020) Traffic signal violation detection using artificial intelligence and deep learning. 2020 5th International Conference on Communication and Electronics Systems (ICCES), pp 839–844

  28. Ravish R, Rangaswamy S, Char K (2021) Intelligent traffic violation detection. In: 2021 2nd Global Conference for Advancement in Technology (GCAT). IEEE, pp 1–7

  29. Asadianfam S, Shamsi M, Kenari AR (2021) TVD-MRDL: traffic violation detection system using MapReduce-based deep learning for large-scale data. Multimed Tools Appl 80(2):2489–2516

    Article  Google Scholar 

  30. Klubsuwan K, Koodtalang W, Mungsing S (2013) Traffic violation detection using multiple trajectories evaluation of vehicles. In: 2013 4th International Conference on Intelligent Systems, Modelling and Simulation. IEEE, pp 220–224

  31. Wankhede SS, Bajaj P (2021) Traffic violation detection model using soft computing tools. In: 2021 6th International Conference for Convergence in Technology (I2CT). IEEE, pp 1–5

  32. Saraswathi A, Mummoorthy A, GR AR, Porkodi KP (2019) Real-time traffic monitoring system using spark. In: 2019 International Conference on Emerging Trends in Science and Engineering (ICESE) vol 1, pp 1–6

  33. Lécué F, Tucker R, Bicer V, Tommasi P, Tallevi-Diotallevi S, Sbodio M (2014) Predicting severity of road traffic congestion using semantic web technologies. In: European Semantic Web Conference. Springer, pp 611–627

  34. Anveshrithaa S, Lavanya K (2020) Real-time vehicle traffic analysis using long short term memory networks in apache spark. In: 2020 International Conference on Emerging Trends in Information Technology and Engineering (IC-ETITE). IEEE, pp 1–5

  35. Wang M, Liu J, Zhou W (2016) Design and implementation of a high-performance stream-oriented big data processing system. In: 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), vol. 1. IEEE, pp 363–368

  36. Ou G, Gao Y, Liu Y (2012) Real-time vehicular traffic violation detection in traffic monitoring stream. In: 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, vol 3. IEEE, pp 15–19

  37. Thain D, Tannenbaum T, Livny M (2005) Distributed computing in practice: the condor experience. Concurr Comput Pract Exp 17(2–4):323–356

    Article  Google Scholar 

  38. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 779–788

  39. Redmon J, Farhadi A (2017) Yolo9000: better, faster, stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 7263–7271

  40. Redmon J, Farhadi A (2018) Yolov3: An incremental improvement. arXiv:1804.02767

  41. Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2117–2125

  42. Bochkovskiy A, Wang C, Liao HM (2020) Yolov4: optimal speed and accuracy of object detection. CoRR arXiv:abs/2004.10934

  43. Jocher G (2022) YOLOv5 in PyTorch, ONNX, CoreML, TFLite. GitHub, github.com. Accessed 17 May 2022. https://github.com/ultralytics/yolov5

  44. Xu Q, Zhu Z, Ge H, Zhang Z, Zang X (2021) Effective face detector based on yolov5 and superresolution reconstruction. Comput Math Methods Med 2021

  45. Wang C-Y, Liao H-YM, Wu Y-H, Chen P-Y, Hsieh J-W, Yeh I-H (2020) CSPNet: A new backbone that can enhance learning capability of CNN. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 390–391

  46. AYOA-f Ihab Abdelkareem (2019) Fully automated red light violation detection. Github. Accessed 17 June 2022. https://github.com/AhmadYahya97/Fully-Automated-red-light-Violation-Detection

  47. Skalski P Online labeling photos tool. Accessed 19 May 2022. https://www.makesense.ai

  48. Sokolova M, Lapalme G (2009) A systematic analysis of performance measures for classification tasks. Inf Process Manag 45(4):427–437

    Article  Google Scholar 

  49. Zaharia M, Chowdhury M, Das T, Dave A, Ma J, McCauly M, Franklin MJ, Shenker S, Stoica I (2012) Resilient distributed datasets: A \(\{\)Fault-Tolerant\(\}\) abstraction for \(\{\)In-Memory\(\}\) cluster computing. In: 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12), pp 15–28

  50. Zaharia M, Das T, Li H, Hunter T, Shenker S, Stoica I (2013) Discretized streams: fault-tolerant streaming computation at scale. In: Proceedings of the Twenty-fourth ACM Symposium on Operating Systems Principles, pp 423–438

Download references

Funding

No funding was received to assist with the preparation of this manuscript.

Author information

Authors and Affiliations

  1. Department of IT, Indian Institute of Information Technology Allahabad, Prayagraj, Uttar Pradesh, India

    Tinku Singh, Vinarm Rajput & Manish Kumar

  2. Department of Mathematics and Statistics, SHUATS, Prayagraj, Uttar Pradesh, India

    Satakshi

  3. Department of Computer Science and Engineering, BIT Mesra, Ranchi, Jharkhand, India

    Umesh Prasad

Authors
  1. Tinku Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vinarm Rajput
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Satakshi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Umesh Prasad
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Manish Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

TS contributed to the conceptualization and methodology. VR contributed to the software and writing—original draft preparation. S was involved in the data curation and visualization. UP assisted in writing—reviewing and editing. MK helped in the investigation and supervision.

Corresponding author

Correspondence to Tinku Singh.

Ethics declarations

Ethical approval

Not applicable.

Competing interests

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, T., Rajput, V., Satakshi et al. Real-time traffic light violations using distributed streaming. J Supercomput 79, 7533–7559 (2023). https://doi.org/10.1007/s11227-022-04977-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-022-04977-4

Keywords

Search

Navigation