07931539
07931539
07931539
Abstract—Automated object detection algorithm is an impor- i.e., the extraction of a license plate region from an image, is
tant research challenge in intelligent urban surveillance systems the key module in a VLPR system [3], which influences the
for Internet of Things (IoT) and smart cities applications. In accuracy of the VLPR systems significantly. Different algo-
particular, smart vehicle license plate recognition and vehi-
cle detection are recognized as core research issues of these rithms have been proposed for identifying a vehicle license
IoT-driven intelligent urban surveillance systems. They are key plate using image processing [4]. One typical way is vertical
techniques in most of the traffic related IoT applications, such as edge matching [5]. The idea is to first locate the two ver-
road traffic real-time monitoring, security control of restricted tical edges of a license plate, and hence to detect its four
areas, automatic parking access control, searching stolen vehicles, corners. In this way, the license plate can be extracted accu-
etc. In this paper, we propose a novel unified method of auto-
mated object detection for urban surveillance systems. We use rately. Using the contrast between the grayscale values, [6]
this novel method to determine and pick out the highest energy proposed a vertical edge-based license plate recognition
frequency areas of the images from the digital camera imaging method.
sensors, that is, either to pick the vehicle license plates or the Another technology is morphology-based license plate
vehicles out from the images. Our proposed method can not only detection. This method is to extract important features of con-
help to detect object vehicles rapidly and accurately, but also can
be used to reduce big data volume needed to be stored in urban trast as guidance to search the license plates [7]. In [8], to
surveillance systems. extract potential text information from the image, a method is
proposed using adaptive threshold, fractal filter and morpho-
Index Terms—Internet of Things (IoT), smart city, smart
transportation, urban surveillance system, vehicle, vehicle license logical analysis. In [9] and [10], edge statistics in combination
plate. with morphological approaches are proposed to eliminate the
undesired edges in the images.
Color-based methods are also attempted which make use
I. I NTRODUCTION
of the colors of the vehicle license plate. In [11], a color-
MART transportation and urban surveillance systems
S are important Internet of Things (IoT) applications for
smart cities [1], [2]. In these smart transportation and urban
based method combined with the texture characteristics is
proposed to try to detect license plate from the color image.
In [12] and [13], the combination of edge information and
surveillance applications, cameras/imaging sensors are com- plate color are utilized to identify the vehicle license plates.
monly installed to automatically detect and identify potential Based on neural network techniques, other recognition
vehicles/cars through automated object detection methods. methods of vehicle license plates are proposed. These meth-
Usually, such automated object detection methods demand ods are designed to train classifiers to offer a proper response
high-complexity image/data processing technologies and algo- to the license plate images. Sun et al. [14] applied genetic
rithms. Hence, the design of low-complexity automated object algorithm to the training process and combine the statistic fea-
detection algorithms becomes an important topic in urban tures together with structure features. In [15], a vehicle license
surveillance systems. Among these researches, both vehi- plate detection method using neural network approaches is
cle license plate recognition (VLPR) and vehicle recognition proposed. The proposed scheme utilizes a neural network
are hot research topics worldwide, which can be applied chip named as CogniMem to detect the vehicle license plates.
to many IoT applications, such as road traffic data col- Sharma et al. [16] proposed a method using wavelet transform
lection/monitoring, automatic parking charging and access technique to decompose the images into different layers, and
control, and searching stolen vehicles. then utilize the low frequency images to combine with neural
It is known that a license plate number is a unique identifi- network technique.
cation of a vehicle. Specifically, the license plate recognition, While most approaches have attempted to deal with the
Manuscript received April 7, 2017; accepted May 4, 2017. Date of publi- VLPR with optical characteristics recognition, another method
cation May 18, 2017; date of current version April 10, 2018. This work was is proposed based on the horizontal and vertical frequency
supported by the Institute of Software Application Technology, Guangzhou energy differences. Rajput et al. [17] used Daubechies wavelet
and Chinese Academy of Sciences and Dongguan CAS Smart City Software
Co. Ltd. under Smart City Urban Surveillance Systems project under Grant transform method to calculate the vertical and horizontal
CSA7035. (Corresponding author: Qiang Ni.) frequency energy curves, considering the frequency is the
The authors are with the School of Computing and Communications, highest near the number plate.
Lancaster University, Lancaster LA1 4WA, U.K. (e-mail:
l.hu@lancaster.ac.uk; q.ni.@lancaster.ac.uk). Other researchers focus on the vehicle recognition.
Digital Object Identifier 10.1109/JIOT.2017.2705560 Mendoza-Schrock et al. [18] proposed a combination of the
2327-4662 c 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
748 IEEE INTERNET OF THINGS JOURNAL, VOL. 5, NO. 2, APRIL 2018
Fig. 8. Horizontal filtered image using improved filter. Fig. 11. Matrix filter in perpendicular direction.
the vehicle information based on different demands of urban [10] B. Hongliang and L. Changping, “A hybrid license plate extrac-
surveillance systems. tion method based on edge statistics and morphology,” in Proc. 17th
IEEE Int. Conf. Pattern Recognit., vol. 2. Cambridge, U.K., 2004,
pp. 831–834.
IV. C ONCLUSION [11] G. Li, R. Yuan, Z. Yang, and X. Huang, “A yellow license plate location
method based on RGB model of color image and texture of plate,”
This paper designs a novel filter which is unified to detect in Proc. 2nd Workshop Digit. Media Appl. Museum Heritages, 2007,
either the vehicle license plates or the vehicles from the digital pp. 42–46.
[12] A. Ahmadyfard and V. Abolghasemi, “Detecting license plate using tex-
camera imaging sensors of urban surveillance systems in smart ture and color information,” in Proc. Int. Symp. Telecommun., 2008,
cities. To the best of our knowledge, we are the first to design pp. 804–808.
this kind of filter to detect the vehicle/license plate objects. We [13] L. Luo, H. Sun, W. Zhou, and L. Luo, “An efficient method of license
plate location,” in Proc. 1st Int. Conf. Inf. Sci. Eng., 2009, pp. 770–773.
tested our filter with different images. The results show that [14] G. Sun, C. Zhang, W. Zou, and G. Yu, “A new recognition method
our filter can automatically detect the highest energy frequency of vehicle license plate based on genetic neural network,” in Proc. 5th
areas out from the images, which makes our proposed algo- IEEE Conf. Ind. Electron. Appl., 2010, pp. 1662–1666.
[15] Y. Liu, D. Wei, N. Zhang, and M. Zhao, “Vehicle-license-plate recog-
rithm a simple and effective method to automatically detect nition based on neural networks,” in Proc. IEEE Int. Conf. Inf. Autom.,
vehicle objects for IoT and smart cities applications. Our 2011, pp. 363–366.
method can also be used to reduce the big data volume which [16] J. Sharma, A. Mishra, K. Saxena, and S. Kumar, “A hybrid technique
for license plate recognition based on feature selection of wavelet trans-
is generated every day from urban surveillance systems in form and artificial neural network,” in Proc. Int. Conf. Rel. Optim. Inf.
smart cities. Technol., Faridabad, India, 2014, pp. 347–352.
[17] H. Rajput, T. Som, and S. Kar, “An automated vehicle license plate
recognition system,” Computer, vol. 48, no. 8, pp. 56–61, Aug. 2015.
R EFERENCES [18] O. Mendoza-Schrock, M. M. Rizki, and V. J. Velten, “Manifold and
[1] S. Chen, H. Xu, D. Liu, B. Hu, and H. Wang, “A vision of IoT: transfer subspace learning for cross-domain vehicle recognition in
Applications, challenges, and opportunities with China perspective,” dynamic systems,” in Proc. 18th Int. Conf. Inf. Fusion, Washington,
IEEE Internet Things J., vol. 1, no. 4, pp. 349–359, Aug. 2014. DC, USA, 2015, pp. 1954–1961.
[2] M. Handte, S. Foell, S. Wagner, G. Kortuem, and P. Marrón, “An [19] W. Pei et al., “A rapid vehicle recognition and retrieval system,” in Proc.
Internet-of-Things enabled connected navigation system for urban bus 2nd Int. Conf. Syst. Informat., Shanghai, China, 2014, pp. 748–753.
riders,” IEEE Internet Things J., vol. 3, no. 5, pp. 735–744, Oct. 2016. [20] G. Burresi and R. Giorgi, “A field experience for a vehicle recognition
[3] B. Li, B. Tian, Q. Yao, and K. Wang, “A vehicle license plate recog- system using magnetic sensors,” in Proc. 4th Mediterr. Conf. Embedded
nition system based on analysis of maximally stable extremal regions,” Comput., 2015, pp. 178–181.
in Proc. 9th IEEE Int. Conf. Netw. Sens. Control, Beijing, China, 2012,
pp. 399–404.
[4] C.-N. E. Anagnostopoulos, I. E. Anagnostopoulos, I. D. Psoroulas,
V. Loumos, and E. Kayafas, “License plate recognition from still images
and video sequences: A survey,” IEEE Trans. Intell. Transp. Syst., vol. 9,
no. 3, pp. 377–391, Sep. 2008.
[5] M. Yu and Y. D. Kim, “An approach to Korean license plate recognition
based on vertical edge matching,” in Proc. IEEE Int. Conf. Syst. Man
Cybern., vol. 4. 2000, pp. 2975–2980.
[6] A. M. Al-Ghaili, S. Mashohor, A. R. Ramli, and A. Ismail, “Vertical- Ling Hu, photograph and biography not available at the time of publication.
edge-based car-license-plate detection method,” IEEE Trans. Veh.
Technol., vol. 62, no. 1, pp. 26–38, Jan. 2013.
[7] J.-W. Hsieh, S.-H. Yu, and Y.-S. Chen, “Morphology-based license plate
detection from complex scenes,” in Proc. 16th IEEE Int. Conf. Pattern
Recognit., Québec City, QC, Canada, 2002, pp. 176–179.
[8] A. A. Lensky, K.-H. Jo, and V. V. Gubarev, “Vehicle license plate detec-
tion using local fractal dimension and morphological analysis,” in Proc.
1st IEEE Int. Forum Strategic Technol., 2006, pp. 47–50.
[9] S.-Z. Wang and H.-J. Lee, “Detection and recognition of license plate
characters with different appearances,” in Proc. IEEE Intell. Transp. Qiang Ni (M’04–SM’08), photograph and biography not available at the time
Syst., vol. 2. Shanghai, China, 2003, pp. 979–984. of publication.