Abstract
Image invariants are those properties of the images of an object that remain unchanged with changes in camera parameters, illumination etc. In this paper, we derive an image invariant for smooth surfaces with mirror-like reflectance. Since, such surfaces do not have an appearance of their own but rather distort the appearance of the surrounding environment, the applicability of geometric invariants is limited. We show that for such smooth mirror-like surfaces, the image gradients exhibit degeneracy at the surface points that are parabolic. We leverage this result in order to derive a photometric invariant that is associated with parabolic curvature points. Further, we show that these invariant curves can be effectively extracted from just a few images of the object in uncontrolled, uncalibrated environments without the need for any a priori information about the surface shape. Since these parabolic curves are a geometric property of the surface, they can then be used as features for a variety of machine vision tasks. This is especially powerful, since there are very few vision algorithms that can handle such mirror-like surfaces. We show the potential of the proposed invariant using experiments on two related applications - object recognition and pose estimation for smooth mirror surfaces.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Adato, Y., Vasilyev, Y., Ben-Shahar, O., Zickler, T.: Toward a Theory of Shape from Specular Flow. In: ICCV (October 2007)
Barrow, H.G., Tenenbaum, J.M., Bolles, R.C., Wolf, H.C.: Parametric correspondence and chamfer matching: two new techniques for image matching. In: Joint Conf. on Artificial Intelligence, pp. 659–663 (1977)
Besl, P., McKay, H.: A method for registration of 3-D shapes. TPAMI 14(2), 239–256 (1992)
Blake, A.: Specular stereo. In: Int. Joint Conf. on Artificial Intelligence, pp. 973–976 (1985)
Blake, A., Brelstaff, G.: Geometry from specularities. In: ICCV, pp. 394–403 (1988)
Bonfort, T., Sturm, P.: Voxel carving for specular surfaces. In: ICCV (October 2003)
Canas, G.D., Vasilyev, Y., Adato, Y., Zickler, T., Gortler, S., Ben-Shahar, O.: A Linear Formulation of Shape from Specular Flow. In: ICCV (September 2009)
Chang, J., Raskar, R., Agrawal, A.: 3D Pose Estimation and Segmentation using Specular Cues. In: CVPR (June 2009)
DelPozo, A., Savarese, S.: Detecting specular surfaces on natural images. In: CVPR (June 2007)
Ding, Y., Yu, J., Sturm, P.: Recovering specular surfaces using curved line images. In: CVPR (June 2009)
Fleming, R.W., Torralba, A., Adelson, E.H.: Specular reflections and the perception of shape. Journal of Vision 4(9), 798–820 (2004)
Gremban, K., Ikeuchi, K.: Planning multiple observations for object recognition. IJCV 12(2), 137–172 (1994)
Haralick, R., Joo, H., Lee, C., Zhuang, X., Vaidya, V., Kim, M.: Pose estimation from corresponding point data. IEEE Trans. on Systems, Man and Cybernetics 19(6), 1426–1446 (1989)
Ihrke, I., Kutulakos, K.N., Lensch, H.P.A., Magnor, M., Heidrich, W., Ihrke, I., Stich, T., Gottschlich, H., Magnor, M., Seidel, H.P.: State of the Art in Transparent and Specular Object Reconstruction. In: IEEE Int. Conf. on Image Analysis and Processing, vol. 12, pp. 188–193 (2005)
Koenderink, J., Van Doorn, A.: Photometric invariants related to solid shape. Journal of Modern Optics 27(7), 981–996 (1980)
Longuet-Higgins, M.S.: Reflection and refraction at a random moving surface. I. Pattern and paths of specular points. Journal of the Optical Society of America 50(9), 838 (1960)
Mamassian, P., Kersten, D., Knill, D.: Categorical local-shape perception. Perception 25, 95–108 (1996)
Miyazaki, D., Kagesawa, M., Ikeuchi, K.: Transparent surface modeling from a pair of polarization images. TPAMI 26(1), 73–82 (2004)
Savarese, S., Chen, M., Perona, P.: Local shape from mirror reflections. IJCV 64(1), 31–67 (2005)
Savarese, S., Fei-Fei, L., Perona, P.: What do reflections tell us about the shape of a mirror? In: Applied Perception in Graphics and Visualization (August 2004)
Vasilyev, Y., Adato, Y., Zickler, T., Ben-Shahar, O.: Dense specular shape from multiple specular flows. In: CVPR (June 2008)
Waldon, S., Dyer, C.: Dynamic shading, motion parallax and qualitative shape. In: IEEE Workshop on Qualitative Vision. pp. 61–70 (1993)
Weidenbacher, U., Bayerl, P., Neumann, H., Fleming, R.: Sketching shiny surfaces: 3D shape extraction and depiction of specular surfaces. ACM Transactions on Applied Perception 3(3), 285 (2006)
Yu, J., McMillan, L.: Modelling Reflections via Multiperspective Imaging. In: CVPR (June 2005)
Zisserman, A., Giblin, P., Blake, A.: The information available to a moving observer from specularities. Image and Vision Computing 7(1), 38–42 (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sankaranarayanan, s.C., Veeraraghavan, A., Tuzel, O., Agrawal, A. (2010). Image Invariants for Smooth Reflective Surfaces. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6312. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15552-9_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-15552-9_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15551-2
Online ISBN: 978-3-642-15552-9
eBook Packages: Computer ScienceComputer Science (R0)