Abstract
In this study, a discriminative detector for object context is designed and tested. The context-feature is simple to implement, feed-forward, and effective across multiple object types in a street-scenes environment.
Using context alone, we demonstrate robust detection of locations likely to contain bicycles, cars, and pedestrians. Furthermore, experiments are conducted so as to address several open questions regarding visual context. Specifically, it is demonstrated that context may be determined from low level visual features (simple color and texture descriptors) sampled over a wide receptive field. At least for the framework tested, high level semantic knowledge, e.g, the nature of the surrounding objects, is superfluous. Finally, it is shown that when the target object is unambiguously visible, context is only marginally useful.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Bar, M., Aminoff, E., Boshyan, J., Fenske, M., Gronauo, N., and Kassam, K. 2005. The contribution of context to visual object recognition. Journal of Vision, 5(8):88a.
Biederman, I., Mezzanotte, R.J., and Rabinowitz, J.C. 1982. Scene perception: Detecting and judging objects undergoing relational violations. Cognitive Psychology, l4.
Belongie, S., Malik, J., and Puzicha J. 2002. Shape Matching and Object Recognition Using Shape Contexts. PAMI.
Bergboer, N.H., Postma, E.O., and van den Herik, H.J. 2003. Context-enhanced object detection in natural images. In Proc. of the Belgian-Netherlands AI Conference (BNAIC).
Bileschi, S.M. and Heisele, B. 2003. Advances in Component Based Face Detection. In Int. Workshop on Analysis and Modeling of Faces and Gestures.
Carbonetto, P., Freitas, N., and Barnard, K. 2004. A Statistical Model for General Contextural Object Recognition. ECCV.
Carson, C., Belongie, S., Greenspan, H., and Malik, J. 1998. Color- and Texture-Based Image Segmentation Using EM and Its Application to Content-Based Image Retrieval, ICCV.
Cox, D., Meyers, E., and Sinha, P. 2004. Contextually Evoked Object-Specific Responses in Human Visual Cortex. Science, 304:115–117.
Fink, M. and Perona, P. 2003. Mutual Boosting for Contextual Inference. NIPS, 17.
Hanson, A.R. and Riseman, E.M. 1978. Visions: A Computer System for Interpreting Scenes. In Computer Vision Systems, Academic Press.
Haralick, R.M. 1983. Decision making in context, PAMI.
Kruppa, H. and Schiele, B. 2003. Using Context To Improve Face Detection. British machine Vision Conference (BMCV).
Kumar, S. and Hebert, M. 2003. Discriminative random fields: A Discriminative Framework for Contextual Interaction in Classification, ICCV.
LeCun, Y. and Jie Huang, F. 2004. Learning Methods for Generic Object Recognition with Invariance to Pose and Lighting. CVPR
Murphy, K., Torralba, A., and Freeman, W. 2003. Using the Forest to See the Trees: A Graphical Model Relating Features, Objects, and Scenes. NIPS, 16.
Schneiderman, H. 2004. Learning a restricted Bayesian network for object detection. CVPR.
Singhal, A., Luo, J., and Zhu, W. 2003. Probabilistic Spatial Context Models for Scene Content Understanding. CVPR.
Strat, T.M. and Fischler, M.A. 1991. Context-based vision: Recognizing Objects Using Information from Both 2D and 3D imagery. PAMI, 13:1050–1065.
Torralba, A., Murphy, K., and Freeman, W. Contextual models for object-detection using boosted random fields. NIPS’04.
Torralba, A., Murphy, K.P., and Freeman, W.T. 2004. Contextual Models for Object Detection using Boosted Random Fields. NIPS.
Torralba, A. and Sinha, P. 2001. Statistical Context Priming for Object Detection. ICCV, pp. 763–770.
Vapnik, V. 1999. The Nature of Statistical Learning Theory. Springer-Verlag.
Viola, P. and Jones, P. 2001. Rapid object detection using a boosted cascade of simple features. CVPR.
Author information
Authors and Affiliations
Corresponding author
Additional information
Both authors contributed equally.
Rights and permissions
About this article
Cite this article
Wolf, L., Bileschi, S. A Critical View of Context. Int J Comput Vision 69, 251–261 (2006). https://doi.org/10.1007/s11263-006-7538-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-006-7538-0