Abstract
In this paper, we detail a system for creating object detectors which meet the extreme demands of real-world traffic sign detection applications such as GPS map making and real-time in-car traffic sign detection. The resulting detectors are designed to detect and locate multiple traffic sign types in high-definition video (high throughput) from several cameras captured along thousands of kilometers of road with minimal false-positives and detection rates in excess of 99%. This allows for the accurate detection and location of traffic signs in geo-tagged video datasets of entire national road networks in reasonable time using only moderate computing infrastructure. A key to the success of the methods described in this paper is the use of extremely efficient classifier features. In this paper, we identify two obstacles to achieving the desired performance for all target traffic sign types, feature memory bandwidth requirements and feature discriminance. We introduce our use of centre-surround histogram of oriented gradient (HOG) statistics which greatly reduce the per-feature memory bandwidth requirements. Subsequently we extend our use of centre-surround HOG statistics to the color domain, raising the discriminant power of the final classifiers for more challenging sign types.
Similar content being viewed by others
References
Alefs, B., Eschemann, G., Ramoser, H., Beleznai, C.: Road sign detection from edge orientation histograms. In: Proceedings of the IEEE Intelligent Vehicles Symposium (IV) (2007)
Bahlmann, C., Zhu, Y., Ramesh, V., Pellkofer, M., Koehler, T.: A system for traffic sign detection, tracking, and recognition using color, shape, and motion information. In: Proceedings of the IEEE Intelligent Vehicles Symposium (IV), pp. 255–260 (2005)
Bishop C. et al.: Pattern recognition and machine learning. Springer, New York (2006)
Broggi, A., Cerri, P., Medici, P., Porta, P., Ghisio, G.: Real time road signs recognition. In: Proceedings of the IEEE Intelligent Vehicles Symposium (IV), pp. 981–986. IEEE (2007)
Burges C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov. 2(2), 121–167 (1998)
Crow, F.: Summed-area tables for texture mapping. In: Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques, pp. 207–212. ACM, New York (1984)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 886–893 (2005)
Duda R.O., Hart P.E., Stork D.G.: Pattern Classification (2nd edn.). Wiley-Interscience, New York (2000)
Friedman J., Hastie T., Tibshirani R.: Additive logistic regression: a statistical view of boosting. Ann. Stat. 28(2), 337–407 (2000)
Kawakami, R., Tan, R.T., Ikeuchi, K.: Consistent Surface Color for Texturing Large Objects in Outdoor Scenes. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), vol. 2 (2005)
Lafuente-Arroyo, S., Gil-Jimenez, P., Maldonado-Bascon, R., Lopez-Ferreras, F., Maldonado-Bascon, S.: Traffic sign shape classification evaluation I: SVM using distance to borders. In: Proceedings of the IEEE Intelligent Vehicles Symposium (IV), pp. 557–562 (2005)
Overett, G., Petersson, L.: On the importance of accurate weak classifier learning for boosted weak classifiers. In: Proceedings of the IEEE Intelligent Vehicles Symposium (IV) (2008)
Overett, G., Petersson, L.: Fast features for time constrained object detection. In: Feature Detectors and Descriptors: The State Of The Art and Beyond (CVPR Workshop) (2009)
Paisitkriangkrai S., Shen C., Zhang J.: Fast pedestrian detection using a cascade of boosted covariance features. IEEE Trans. Circuits Syst. Video Technol. 18(8), 1140–1151 (2008)
Paulo, C.F., Correia, P.L.: Automatic detection and classification of traffic signs. In: International Workshop on Image Analysis for Multimedia Interactive Services, p. 11 (2007)
Pettersson, N., Petersson, L., Andersson, L.: The histogram feature – a resource-efficient weak classifier. In: Proceedings of the IEEE Intelligent Vehicles Symposium (IV) (2008)
Porikli, F.: Integral histogram: a fast way to extract histograms in cartesian spaces. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1 (2005)
Rosenberg, C., Hebert, M., Thrun, S.: Color constancy using kl-divergence. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 239–246 (2001)
Schapire R.E., Singer Y.: Improved boosting algorithms using confidence-rated predictions. Mach. Learn. 37(3), 297–336 (1999)
Timofte, R., Zimmermann, K., Van Gool, L.: Multi-view traffic sign detection, recognition, and 3D localisation. In: Applications of Computer Vision (WACV), 2009 Workshop on, pp. 1–8. IEEE (2010)
Tuzel, O., Porikli, F., Meer, P.: Pedestrian detection via classification on Riemannian manifolds. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1713–1727 (2008)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, p. 511. IEEE Computer Society (2001)
Viola P., Jones M.: Fast and Robust Classification using Asymmetric AdaBoost and a Detector Cascade. Adv Neural Inf. Process. Syst. (ANIPS) 2, 1311–1318 (2002)
Wu, J., Mullin, M., Rehg, J.: Linear asymmetric classifier for cascade detectors. In: Machine Learning, vol. 22, p. 993 (2005)
Wulf W.A., McKee S.A.: Hitting the memory wall: implications of the obvious. SIGARCH Comput. Archit. News 23(1), 20–24 (1995)
Zhang, C., Viola, P.: Multiple-instance pruning for learning efficient cascade detectors. In: Advances In Neural Information Processing Systems (ANIPS) (2007)
Zhang, L., Wu, B., Nevatia, R.: Pedestrian detection in infrared images based on local shape features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2007)
Zhu, Q., Yeh, M.C., Cheng, K.T., Avidan, S.: Fast human detection using a cascade of histograms of oriented gradients. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1491–1498. IEEE Computer Society (2006)
Author information
Authors and Affiliations
Corresponding author
Additional information
NICTA is funded by the Australian Government as represented by the Department of Broadband, Communications and the Digital Economy and the Australian Research Council through the ICT Centre of Excellence program.
Rights and permissions
About this article
Cite this article
Overett, G., Tychsen-Smith, L., Petersson, L. et al. Creating robust high-throughput traffic sign detectors using centre-surround HOG statistics. Machine Vision and Applications 25, 713–726 (2014). https://doi.org/10.1007/s00138-011-0393-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-011-0393-1