Abstract
License plate recognition is instrumental in many forensic investigations involving organized crime and gang crime, burglaries and trafficking of illicit goods or persons. After an incident, recordings are collected by police officers from cameras in-the-wild at gas stations or public facilities. In such an uncontrolled environment, a generally low image quality and strong compression oftentimes make it impossible to read license plates. Recent works showed that characters from US license plates can be reconstructed from noisy, low resolution pictures using convolutional neural networks (CNN). However, these studies do not involve compression, which is arguably the most prevalent image degradation in real investigations.
In this paper, we present work toward closing this gap and investigate the impact of JPEG compression on license plate recognition from strongly degraded images. We show the efficacy of the CNN on a real-world dataset of Czech license plates.
Using only synthetic data for training, we show that license plates with a width larger than 30 pixels, an SNR above –3 dB, and a JPEG quality factor down to 15 can at least partially be reconstructed. Additional analyses investigate the influence of the position of the character in the license plate and the similarity of characters.
We gratefully acknowledge support by the German Federal Ministry of Education and Research (BMBF) under Grant No. 13N15319, the German Research Foundation GRK Cybercrime (393541319/GRK2475/1-2019), and the German Research Foundation (146371743/TRR 89).
P. Kaiser and F. Schirrmacher—Both authors contributed equally to this work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abdullah, S., Mahedi Hasan, M., Islam, S.: YOLO-based three-stage network for Bangla license plate recognition in Dhaka metropolitan city. In: International Conference on Bangla Speech and Language Processing, pp. 1–6 (2018)
Agarwal, S., Tran, D., Torresani, L., Farid, H.: Deciphering severely degraded license plates. In: Media Watermarking, Security, and Forensics, pp. 138–143 (2017)
Arafat, M.Y., Khairuddin, A.S.M., Khairuddin, U., Paramesran, R.: Systematic review on vehicular licence plate recognition framework in intelligent transport systems. IET Intel. Transport Syst. 13, 745–755 (2019)
Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans. Circuits Syst. Video Technol. 23(2), 311–325 (2013)
Farid, H.: Photo Forensics. MIT Press, Cambridge (2016)
Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: International Conference on Artificial Intelligence and Statistics, pp. 249–256 (2010)
Gonçalves, G.R., Diniz, M.A., Laroca, R., Menotti, D., Schwartz, W.R.: Real-time automatic license plate recognition through deep multi-task networks. In: 31st Conference on Graphics, Patterns and Images, pp. 110–117 (2018)
Goodfellow, I., Bulatov, Y., Ibarz, J., Arnoud, S., Shet, V.: Multi-digit number recognition from street view imagery using deep convolutional neural networks. In: International Conference on Learning Representations (2014)
Jaderberg, M., Simonyan, K., Vedaldi, A., Zisserman, A.: Reading text in the wild with convolutional neural networks. Int. J. of Comput. Vis. 116(1), 1–20 (2016)
Kilic, I., Aydin, G.: Turkish vehicle license plate recognition using deep learning. In: International Conference on Artificial Intelligence and Data Processing, pp. 1–5 (2018)
Li, H., Wang, P., You, M., Shen, C.: Reading car license plates using deep neural networks. Image Vis. Comput. 72, 14–23 (2018)
Liu, L., Zhang, H., Feng, A., Wan, X., Guo, J.: Simplified local binary pattern descriptor for character recognition of vehicle license plate. In: International Conference on Computer Graphics, Imaging and Visualization, pp. 157–161 (2010)
Liu, P., Li, G., Tu, D.: Low-quality license plate character recognition based on CNN. In: International Symposium on Computational Intelligence and Design, pp. 53–58 (2015)
Llorens, D., Marzal, A., Palazón, V., Vilar, J.M.: Car license plates extraction and recognition based on connected components analysis and HMM decoding. In: Pattern Recognition and Image Analysis, pp. 571–578 (2005)
Lorch, B., Agarwal, S., Farid, H.: Forensic reconstruction of severely degraded license plates. In: Electronic Imaging (January 2019)
Ministerstvo vnitra České republiky: Collection of laws no. 343/2014 (2014). https://aplikace.mvcr.cz/sbirka-zakonu/ViewFile.aspx?type=z&id=27609
Pei-Lun, H., Liang, Y.M., Liao, H.Y.M.: Recognition of blurred license plate images. In: IEEE International Workshop on Information Forensics and Security (2010)
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: IEEE Conference on Computer Vision and Pattern Recognition (2016)
Shivakumara, P., Tang, D., Asadzadeh, M., Lu, T., Pal, U., Anisi, H.: CNN-RNN based method for license plate recognition. CAAI Trans. on Intell. Technol. 3(3), 169–175 (2018)
Silva, S.M., Jung, C.R.: Real-time Brazilian license plate detection and recognition using deep convolutional neural networks. In: Conference on Graphics, Patterns and Images, pp. 55–62 (2017)
Silva, S.M., Jung, C.R.: License plate detection and recognition in unconstrained scenarios. In: European Conference on Computer Vision, pp. 580–596 (2018)
Špaňhel, J., Sochor, J., Juránek, R., Herout, A., Maršík, L., Zemčík, P.: Holistic recognition of low quality license plates by CNN using track annotated data. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 1–6 (2017)
Suvarnam, B., Ch, V.S.: Combination of CNN-GRU model to recognize characters of a license plate number without segmentation. In: International Conference on Advanced Computing & Communication Systems, pp. 317–322 (2019)
Wen, Y., Lu, Y., Yan, J., Zhou, Z., Von Deneen, K., Shi, P.: An algorithm for license plate recognition applied to intelligent transportation system. IEEE Trans. Intell. Transp. Syst. 12, 830–845 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kaiser, P., Schirrmacher, F., Lorch, B., Riess, C. (2021). Learning to Decipher License Plates in Severely Degraded Images. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12666. Springer, Cham. https://doi.org/10.1007/978-3-030-68780-9_43
Download citation
DOI: https://doi.org/10.1007/978-3-030-68780-9_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-68779-3
Online ISBN: 978-3-030-68780-9
eBook Packages: Computer ScienceComputer Science (R0)
