Article

What do reflections tell us about the shape of a mirror?

Authors:

Silvio Savarese,

Pietro PeronaAuthors Info & Claims

APGV '04: Proceedings of the 1st Symposium on Applied perception in graphics and visualization

Pages 115 - 118

https://doi.org/10.1145/1012551.1012571

Published: 07 August 2004 Publication History

Abstract

Three-dimensional shape may be perceived from static images. Contours, shading, texture gradients, perspective and occlusion are well-studied cues to this percept. When looking at a picture of a specular object, such as a silver vase, one additional cue is potentially available: a deformed picture of the reflected environment is seen in the surface of the object and the amount and type of deformation depend on its shape. Can specular reflections be used as a visual cue for shape perception? Our experiments show that our subjects are very poor at judging the shape of mirror surfaces in absence of other visual cues. However, for a considerable subset of the stimuli, subjects are highly consistent in their (most often wrong) perception. This observation leads us to the hypothesis that our subjects rather than 'computing' a percept from each image based on geometrical considerations, may be associating a shape to each pattern in a stereotypical way, akin to pattern-matching. This behavior is reasonable since, as suggested by our ideal observer analysis, the information available from specular reflections is ambiguous when the surrounding world is (partially) unknown.

References

[1]

BECK, J., AND PRAZDNY, S. 1981. Highlights and the perception of glossiness. In Perception and Psychoph., vol. 30, 407--410.

[2]

BLAKE, A., AND BRELSTAFF, G. 1988. Geometry from specularities. In Proc. of Int Conf. of Computer Vision, 394--403.

[3]

BLAKE, A., AND BÜLTHOFF, H. 1990. Does the brain know the physics of specular reflection? In Nature, vol. 343, 165--168.

[4]

BLAKE, A., BÜLTHOFF, H., AND SHEINBERG, D. 1993. Shape from texture: ideal observers and human psychophysics. In Vision Research, vol. 33, 1723--37.

[5]

FLEMING, R., TORRALBA, A., AND ADELSON, E. H. 2003. How image statistics drive shape-from-texture and shape-from-specularities. In Proc. of Third Annual Meeting of the VSS - http://journalofvision.org.

[6]

FLEMING, R. W., DROR, R. O., AND ADELSON, E. H. 2003. How do humans determine reflectance properties under unknown illumination? In Journal of Vision, vol. 3, 347--368.

[7]

KIM, S., HAGH-SHENAS, H., AND INTERRANTE, V. 2004. Conveying shape with texture: experimental investigations of texture's effects on shape categorization judgments. In IEEE Transactions on Visualization and Computer Graphics.

Digital Library

[8]

KNILL, D. 1998. Surface orientation from texture: Ideal observers, generic observers and the information content of texture cues. In Vision Research, vol. 38, 1655--1682.

[9]

KOENDERINK, J., AND DOORN, A. V. 1980. Photometric invariants related to solid shape. In Acta Optica, vol. 27, 981--996.

[10]

LU, R., KOENDERINK, J., AND KAPPERS, A. M. 1999. Surface roughness from highlight structure. In Applied Optics, vol. 38, 2886--2894.

[11]

MALIK, J., AND ROSENHOLTZ, R. 1997. Surface orientation from texture: Isotropy or homogeneity (or both?). In Vision Research, vol. 37, 2283--2293.

[12]

NAYAR, S., AND OREN, M. 1995. Visual appearance of matte surfaces. In Science, vol. 267, 1153--1156.

[13]

OREN, M., AND NAYAR, S. 1997. A theory of specular surface geometry. In Trans. Int. Journal of Computer Vision, 105--124.

Digital Library

[14]

SAVARESE, S., FEI-FEI, L., AND PERONA, P. 2003. Can we see the shape of a mirror? In Proc. of 3rd Annual Meeting of VSS - http://journalofvision.org.

[15]

SAVARESE, S., CHEN, M., AND PERONA, P. 2004. Recovering local shape of a mirror surface from reflection of a regular grid. In Proc. of European Conference of Computer Vision.

[16]

TODD, J. T., AND AKERSTROM, R. A. 1987. Perception of three-dimensional form from patterns of optical texture. In Perception and Psychophysics, vol. 13, 242--255.

[17]

TODD, J. T., NORMAN, J. F., AND KOENDERINK, J. 1997. Effects of texture, illumination, and surface reflectance on stereoscopic shape perception. In Perception, vol. 26, 807--822.

[18]

ZAIDI, Q., AND LI, A. 2002. Limitations on shape information provided by texture cues. In Vision Research, vol. 47, 815--835.

[19]

ZISSERMAN, A., GIBLIN, P., AND BLAKE, A. 1989. The information available to a moving observer from specularities. In Image and Video Computing, vol. 7, 38--42.

Digital Library

Cited By

Shimokawa T(2023)3D shape recovery algorithm from image orientations of textured surfacesJournal of the Optical Society of America A10.1364/JOSAA.49143340:9(1673)Online publication date: 8-Aug-2023
https://doi.org/10.1364/JOSAA.491433
Shimokawa TNishio ASato MKawato MKomatsu H(2019)Computational Model for Human 3D Shape Perception From a Single Specular ImageFrontiers in Computational Neuroscience10.3389/fncom.2019.0001013Online publication date: 1-Mar-2019
https://doi.org/10.3389/fncom.2019.00010
Schlüter NFaul F(2019)Visual shape perception in the case of transparent objectsJournal of Vision10.1167/19.4.2419:4(24)Online publication date: 22-Apr-2019
https://doi.org/10.1167/19.4.24
Show More Cited By

What do reflections tell us about the shape of a mirror?
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
  2. Computer graphics

Recommendations

Perception of qualitative shape from diffuse and specular reflections
SAP '12: Proceedings of the ACM Symposium on Applied Perception

The shape we perceive from a rendered surface depends on the true surface shape, but also on the surface reflectance, the illumination, the surface motion, and the viewer's position. Here we present an experiment that addresses how perceived shape ...
Conveying three-dimensional shape with texture
APGV '04: Proceedings of the 1st Symposium on Applied perception in graphics and visualization

Studies have shown that although shading is an important shape cue, visual perception of surface shape from shading only is severely limited when the surface is viewed locally without other visual cues such as occluding contours [Mamassian and Kersten ...
Environment maps and the perception of shape from mirror reflections
SAP '13: Proceedings of the ACM Symposium on Applied Perception

Environment maps are commonly used in computer graphics to approximate the appearance of smoothly curved surfaces with mirror-like reflectance. Perceiving the shape of such surfaces is a challenging task for the visual system, however, because the image ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

APGV '04: Proceedings of the 1st Symposium on Applied perception in graphics and visualization

August 2004

184 pages

ISBN:1581139144

DOI:10.1145/1012551

Conference Chairs:
Victoria Interrante
University of Minnesota
,
Ann McNamara
St. Louis University
,
Program Chairs:
Heinrich Bulthoff
Max-Planck Institute for Biological Cybernetics
,
Holly Rushmeier
Yale University

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 August 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

APGV04

Sponsor:

SIGGRAPH

APGV04: ACM Symposium on Applied Perception in Graphics and Visualization 2004

August 7 - 8, 2004

California, Los Angeles, USA

Acceptance Rates

Overall Acceptance Rate 19 of 33 submissions, 58%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
365
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shimokawa T(2023)3D shape recovery algorithm from image orientations of textured surfacesJournal of the Optical Society of America A10.1364/JOSAA.49143340:9(1673)Online publication date: 8-Aug-2023
https://doi.org/10.1364/JOSAA.491433
Shimokawa TNishio ASato MKawato MKomatsu H(2019)Computational Model for Human 3D Shape Perception From a Single Specular ImageFrontiers in Computational Neuroscience10.3389/fncom.2019.0001013Online publication date: 1-Mar-2019
https://doi.org/10.3389/fncom.2019.00010
Schlüter NFaul F(2019)Visual shape perception in the case of transparent objectsJournal of Vision10.1167/19.4.2419:4(24)Online publication date: 22-Apr-2019
https://doi.org/10.1167/19.4.24
Lu JJi YYu JYe J(2019)Mirror Surface Reconstruction Using Polarization Field2019 IEEE International Conference on Computational Photography (ICCP)10.1109/ICCPHOT.2019.8747335(1-9)Online publication date: May-2019
https://doi.org/10.1109/ICCPHOT.2019.8747335
Morgand ATamaazousti MBartoli A(2018)A Geometric Model for Specularity Prediction on Planar Surfaces with Multiple Light SourcesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.267744524:5(1691-1704)Online publication date: 1-May-2018
https://doi.org/10.1109/TVCG.2017.2677445
Schlüter NFaul F(2016)Matching the Material of Transparent Objects: The Role of Background Distortionsi-Perception10.1177/20416695166696167:5(204166951666961)Online publication date: 12-Sep-2016
https://doi.org/10.1177/2041669516669616
Vergne RBarla PBonneau GFleming R(2016)Flow-guided warping for image-based shape manipulationACM Transactions on Graphics10.1145/2897824.292593735:4(1-12)Online publication date: 11-Jul-2016
https://dl.acm.org/doi/10.1145/2897824.2925937
Morgand ATamaazousti MBartoli A(2016)An Empirical Model for Specularity Prediction with Application to Dynamic Retexturing2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR.2016.13(44-53)Online publication date: Sep-2016
https://doi.org/10.1109/ISMAR.2016.13
Godard CHedman PLi WBrostow G(2015)Multi-view Reconstruction of Highly Specular Surfaces in Uncontrolled EnvironmentsProceedings of the 2015 International Conference on 3D Vision10.1109/3DV.2015.10(19-27)Online publication date: 19-Oct-2015
https://dl.acm.org/doi/10.1109/3DV.2015.10
Dövencioğlu DWijntjes MBen-Shahar ODoerschner K(2015)Effects of surface reflectance on local second order shape estimation in dynamic scenesVision Research10.1016/j.visres.2015.01.008115(218-230)Online publication date: Oct-2015
https://doi.org/10.1016/j.visres.2015.01.008
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents