Abstract
In this paper, we describe the development of a symmetry-based vehicle detection system. The system uses a single forward looking camera to capture the road scene. Vehicles are detected based on their edges and symmetrical characteristics. A method to extract the symmetric regions in the image using a multi-sized window and clustering technique is introduced. We hypothesize the vehicle’s locations in the image from the detected symmetric regions and the regions are then further processed to enhance their symmetrical edges. A bounding box of a vehicle is detected from the projection maps of the enhanced vertical and horizontal edges. The hypothesized vehicles are then verified using a two-class classifier, which consists of an edge oriented histogram (EOH) feature extractor and a support vector machine (SVM). Once a vehicle is verified, a tracking process based on a Kalman filter and a reliability point system is used to track the movement of the vehicle in consecutive video frames. The system was successfully implemented and tested on a standard PC. Experimental results on live video feed and pre-recorded video sequences for various road scenes showed that the system is able to detect multiple vehicles in real time.
Similar content being viewed by others
References
Zehang S., Bebis G., Miller R.: On-road vehicle detection: a review. IEEE Trans. Pattern Anal. Mach. Intell. 28(5), 694–711 (2006)
Steux, B., Laurgeau, C., Salesse, L., Wautier, D.: Fade: A vehicle detection and tracking system featuring monocular color vision and radar data fusion. In: Intelligent Vehicle Symposium, 2002. IEEE, vol. , pp. 632–639 (2002)
Srinivasa, N., Yang, C., Daniell, C.: A fusion system for real-time forward collision warning in automobiles. In: Proceedings of the 2003 Intelligent Transportation Systems (IEEE 2003), vol. 1, pp. 57–462 (2003)
Kadow, U., Schneider, G., Vukotich, A.: Radar-vision based vehicle recognition with evolutionary optimized and boosted features. In: Intelligent Vehicles Symposium, 2007. IEEE, pp. 749–754 (2007)
Nedevschi, S., Vatavu, A., Oniga, F., Meinecke, M.M.: Forward collision detection using a stereo vision system. In: 4th International Conference on Intelligent Computer Communication and Processing, 2008 (ICCP 2008), pp. 115–122 (2008)
Huh K., Park J., Hwang J., Hong D.: A stereo vision-based obstacle detection system in vehicles. Optics Lasers Eng. 46(2), 168–178 (2008)
Bertozzi, M., Broggi, A., Fascioli, A., Nichele, S.: Stereo vision-based vehicle detection. In: Proceedings of the IEEE Intelligent Vehicles Symposium, 2000 (IV 2000), pp. 39–44 (2000)
Horn B.K.P., Schunck B.G.: Determining optical flow. Artif. Intell. 17, 185–203 (1981)
Smith S.M., Brady J.M.: Asset-2: real-time motion segmentation and shape tracking. IEEE Trans. Pattern Anal. Mach. Intell. 17(8), 814–820 (1995)
Heisele, B., Ritter, W.: Obstacle detection based on color blob flow. In: Proceedings of the Intelligent Vehicles ’95 Symposium, pp. 282–286 (1995)
Seelen, C.T., von, W.: Vehicle detection in traffic scenes using shadows. Tech. rep., Institut fur Neuroinformatik, Ruhr-Universitat, Bochum, Germany, Inter. rep (1998)
Van Leeuwen M.B., Groen F.C.A.: Vehicle detection with a mobile camera: spotting midrange, distant, and passing cars. IEEE Robot. Autom. Mag. 12(1), 37–43 (2005)
Betke M., Haritaoglu E., Davis L.S.: Real-time multiple vehicle detection and tracking from a moving vehicle. Mach. Vis. Appl. 12(2), 69–83 (2000)
Bertozzi M., Broggi A., Castelluccio S.: A real-time oriented system for vehicle detection. J. Syst. Archit. 43, 317–325 (1997)
Bensrhair, A., Bertozzi, A., Broggi, A., Fascioli, A., Mousset, S., Toulminet, G.: Stereo vision-based feature extraction for vehicle detection. In: Intelligent Vehicle Symposium, 2002. IEEE, vol. 2, pp. 465–470 (2002)
Bin, D., Yajun, F., Tao, W.: A vehicle detection method via symmetry in multi-scale windows. In: 2nd IEEE Conference on Industrial Electronics and Applications, 2007 (ICIEA 2007), pp. 1827–1831 (2007)
Wei, L., XueZhi, W., Bobo, D., Huai, Y., Nan, W.: Rear vehicle detection and tracking for lane change assist. In: Intelligent Vehicles Symposium, 2007 IEEE, pp. 252–257 (2007)
Zielke, T., Brauckmann, M., Seelen, W.V.: Intensity and edge-based symmetry detection with an application to car-following. In: CVGIP: Image Understanding, 58(2), pp. 177–190 (1993)
Kuehnle A.: Symmetry-based recognition of vehicle rears. Pattern Recognit. Lett. 12(4), 249–258 (1991)
Du, Y., Papanikolopoulos, N.P.: Real-time vehicle following through a novel symmetry-based approach. In: Proceedings of 1997 IEEE International Conference on Robotics and Automation, vol. 4, pp. 3160–3165 (1997)
Bucher T., Curio C., Edelbrunner J., Igel C., Kastrup D., Leefken I., Lorenz G., Steinhage A., von Seelen W.: Image processing and behavior planning for intelligent vehicles. IEEE Trans. Ind. Electron. 50(1), 62–75 (2003)
Luo-Wei T., Jun-Wei H., Kuo-Chin F.: Vehicle detection using normalized color and edge map. IEEE Trans. Image Process. 16(3), 850–864 (2007)
Yen-Lin, C., Yuan-Hsin, C., Chao-Jung, C., Bing-Fei, W.: Nighttime vehicle detection for driver assistance and autonomous vehicles. In: 18th International Conference on Pattern Recognition, 2006 (ICPR 2006), vol. 1, pp. 687–690 (2006)
Eichner, M., Breckon, T.: Real-time video analysis for vehicle lights detection using temporal information. IET Conference Publications 2007(CP534), 15–15 (2007)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Conference on Computer Vision and Pattern Recognition (2001)
Canny J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)
Zafarifar, B., Weda, H., de With, P.H.N.: Horizon detection based on sky-color and edge features. In: Society of Photo-Optical Instrumentation Engineers SPIE Conference Series, vol. 6822 (2008)
Vapnik V.N.: The Nature of Statistical Learning Theory. Springer, New York (1995)
Han, Z., Ye, Q., Jiao, J.: Online feature evaluation for object tracking using Kalman filter. In: 19th International Conference on Pattern Recognition, 2008 (ICPR 2008), pp. 1–4 (2008)
Cuevas, E., Zaldivar, D., Rojas, R.: Kalman filter for vision tracking. Measurement (August), 1–18 (2005)
Kohler, M.: Using the Kalman filter to track human interactive motion modelling and initialization of the Kalman filter for translational motion. Tech. rep., University of Dortmund, Germany (1997)
Boeing, A., Braunl, T.: ImprovCV: Open component based automotive vision. In: Intelligent Vehicles Symposium, 2008 IEEE, pp. 297–302 (2008)
Hawe, S.: A component-based image processing framework for automotive vision. Master’s thesis, University of Western Australia (2008)
OpenCV (open source computer vision) wiki. http://opencv.willowgarage.com/wiki/. Accessed on 1st June 2010
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Teoh, S.S., Bräunl, T. Symmetry-based monocular vehicle detection system. Machine Vision and Applications 23, 831–842 (2012). https://doi.org/10.1007/s00138-011-0355-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-011-0355-7