research-article

Local Surface Shape Estimation of 3-D Textured Surfaces using Gaussian Markov Random Fields and Stereo Windows

Authors:

M. A. S. Patel,

F. S. CohenAuthors Info & Claims

IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 15, Issue 10

Pages 1091 - 1098

https://doi.org/10.1109/34.254067

Published: 01 October 1993 Publication History

Abstract

The problem of extracting the local shape information of a 3-D texture surface from a single 2-D image by tracking the perceived systematic deformations the texture undergoes by virtue of being present on a 3-D surface and by virtue of being imaged is examined. The surfaces of interest are planar and developable surfaces. The textured objects are viewed as originating by laying a rubber planar sheet with a homogeneous parent texture on it onto the objects. The homogeneous planar parent texture is modeled by a stationary Gaussian Markov random field (GMRF). A probability distribution function for the texture data obtained by projecting the planar parent texture under a linear camera model is derived, which is an explicit function of the parent GMRF parameters, the surface shape parameters. and the camera geometry. The surface shape parameter estimation is posed as a maximum likelihood estimation problem. A stereo-windows concept is introduced to obtain a unique and consistent parent texture from the image data that, under appropriate transformations, yields the observed texture in the image. The theory is substantiated by experiments on synthesized as well as real images of textured surfaces.

References

[1]

{1} B. K. P. Horn, Robot Vision. New York: McGraw-Hill, 1986.

Digital Library

[2]

{2} D. Marr, "Representing visual information--A computational approach," in Computer Vision Systems, A. R. Hanson and E. M. Riseman, Eds. New York: Academic, 1978.

[3]

{3} B. K. P. Horn, "Obtaining shape from shading information," in Psychology of Computer Vision, P. H. Winston, Ed. New York: McGraw-Hill, 1975, ch. 4.

[4]

{4} B. K. P. Horn and R. W. Sjoberg, "Calculating the reflectance map," Applied Opt., vol. 18, June 1979.

[5]

{5} D. Marr, "Analysis of occluding contour," in Proc. Royal Soc. Lon. B, vol. 197, 1977.

[6]

{6} K. A. Stevens, "The visual interpretation of visual contours," Artificial Intell., vol. 17, Aug. 1981.

[7]

{7} J. J. Gibson, The Perception of the Visual World. Boston: Houghton Mifflin, 1950.

[8]

{8} R. Bajcsy and L. Lieberman, "Texture gradients as a depth cue," Comput. Graphics Image Processing, vol. 5, 1976.

[9]

{9} Y. C. Jau and R. T. Chinn, "Shape from texture using the Wigner distribution," Comput. Vision Graphics Image Processing, vol. 52, no. 2, Nov. 1990.

Digital Library

[10]

{10} A. P. Witkin, "Recovering surface shape and orientation from texture," Artificial Intell., vol. 17, 1981.

[11]

{11} L. S. Davis, L. Lanos, and S. M. Dunn, "Efficient recovery of shape from texture," IEEE Trans. Pattern Anal. Machine Intell., vol. 5, no. 5, 1983.

Digital Library

[12]

{12} K. Kanatani, "Detection of surface orientation and motion from texture by stereological technique," Artificial Intell., vol. 23, 1984.

Digital Library

[13]

{13} K. Ikeuchi, "Shape from regular patterns," Artificial Intell., vol. 22, 1984.

[14]

{14} J. R. Kender, "Shape from texture," Ph.D. dissertation, Carnegie-Mellon Univ., Pittsburgh, PA, Rep. CMU-CS-81-102, Nov. 1980.

Digital Library

[15]

{15} Y. Ohta, K. Maenobu, and T. Sakai, "Obtaining surface orientation from texels under perspective projection," in Proc. Int. Joint Conf. Artificial Intell., 1980.

[16]

{16} D. Blostein, and N. Ahuja, "Shape from texture: Integrating textureelement extraction and surface estimation," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, no. 12, 1989.

Digital Library

[17]

{17} D. Brzakovic, "Computer based 3-D description from texture," Ph.D. dissertation, Dept. of Elect. Eng., Univ. of Florida, 1984.

[18]

{18} L. G. Brown and H. Shvaytser, "Surface orientation from projective foreshortening of isotropic texture autocorrelation," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, no. 6, 1990.

Digital Library

[19]

{19} Y. Choe and R. Kashyap, "3-D Shape from a shaded and textured surface image," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, no. 9, 1991.

Digital Library

[20]

{20} R. Chellappa and R. Kashyap, "Texture synthesis using 2-D noncausal autoregressive models," IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-33, Feb. 1985.

[21]

{21} F. S. Cohen, "Markov random fields for image modelling and analysis," in Modeling and Applications of Stochastic Processes, U. B. Desai, Ed. Boston: Kluwer, 1986.

Digital Library

[22]

{22} F. S. Cohen and D. B. Cooper, "Simple parallel hierarchical and relaxation algorithms for segmenting noncausal Markov random fields," IEEE Trans. Pattern Anal. Machine Intell. Mar. 1987.

Digital Library

[23]

{23} F. S. Cohen and M. S. Patel, "Modeling and synthesis of images of 3-D textured surfaces," CVGIP: Graphical Models Image Processing, vol. 53, no. 6, Nov. 1991.

[24]

{24} F. S. Cohen and M. S. Patel, "Shape from texture using Gaussian Markov random fields," in Theory and Applications of Markov Random Fields for Image Processing, R. Chellappa and A. K. Jain, Eds. New York: Academic, 1993.

[25]

{25} J. Woods, "Two-dimensional discrete Markov random fields," IEEE Trans. Inform. Theory, vol. IT-18, 1972.

[26]

{26} J. Besag, "Spatial interaction and the statistical analysis of lattice systems," J. Royal Stat. Soc., Series B, vol. 36, 1974.

[27]

{27} J. Besag and P. Moran, "On the estimation and testing of spatial interaction in Gaussian lattices," Biometrika, vol. 62, 1975.

[28]

{28} R. Kashyap and R. Chellappa, "Estimation and choice of neighbors in spatial interaction models of images," IEEE Trans. Inform. Theory, vol. IT-29, Jan. 1983.

[29]

{29} F. S. Cohen, Z. Fan, and M. S. Patel, "Classification of rotated and scaled textured images using Gaussian Markov random field models," IEEE Trans. Pattern Anal. Machine Intell., Feb. 1991.

Digital Library

[30]

{30} P. J. Besl and R. C. Jain, "Intrinsic and extrinsic surface characteristics," in Proc. Int. Conf. Comput. Vision Patt. Recogn., 1985.

[31]

{31} R. D. Rimey and F. S. Cohen, "A maximum likelihood approach for segmenting range data," IEEE Trans. Robotics Automat., Apr. 1988.

[32]

{32} A. Rosenfeld and A. Kak, Digital Picture Processing. New York: Academic, 1992, vol. 2.

Digital Library

[33]

{33} P. Brodatz, Textures. New York: Dover.

[34]

{34} M. S. Patel, "Shape extraction of 3-D textured scenes from image data," Ph.D. Dissertation, Drexel Univ. Elect. Comput. Eng. Dept., Aug. 1991.

Digital Library

[35]

{35} J. Aloimonos, "Shape from texture," Biological Cybern., vol. 58, 1988.

Digital Library

[36]

{36} W. Larimore, "Statistical inference on stationary random fields," Proc. IEEE, vol. 65, no. 6, June 1977.

[37]

{37} M. S. Patel and F. S. Cohen, "Shape from texture using Markov random field models and stereo-windows," CVPR, 1992.

Cited By

Raviv DJoarder K(2018)The Visual Looming Navigation CueComputer Vision and Image Understanding10.1006/cviu.2000.086279:3(331-363)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1006/cviu.2000.0862
Suen PHealey G(2000)The Analysis and Recognition of Real-World Textures in Three DimensionsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/34.85700522:5(491-503)Online publication date: 1-May-2000
https://dl.acm.org/doi/10.1109/34.857005

Local Surface Shape Estimation of 3-D Textured Surfaces using Gaussian Markov Random Fields and Stereo Windows

Recommendations

Retrieving Shape Information from Multiple Images of a Specular Surface

In many remote sensing and machine vision applications, the shape of a specular surface such as water, glass, or polished metal must be determined instantaneously and under natural lighting conditions. Most image analysis techniques, however, assume ...
On mathematical folding of curved crease origami: Sliding developables and parametrizations of folds into cylinders and cones
Abstract
Motivated by the art of curved crease origami we study mathematical models for folding ideal paper along curved creases. We approach the problem of finding mathematical descriptions in terms of developable surfaces of those shapes ...
Highlights
- We compute explicit isometric deformations of developable surfaces that are guided by sliding on planes.
Dev2PQ: Planar Quadrilateral Strip Remeshing of Developable Surfaces
We introduce an algorithm to remesh triangle meshes representing developable surfaces to planar quad dominant meshes. The output of our algorithm consists of planar quadrilateral (PQ) strips that are aligned to principal curvature directions and closely ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Pattern Analysis and Machine Intelligence

IEEE Transactions on Pattern Analysis and Machine Intelligence Volume 15, Issue 10

October 1993

129 pages

ISSN:0162-8828

Issue’s Table of Contents

Copyright © Copyright © 1993 IEEE. All Rights Reserved.

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 October 1993

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Raviv DJoarder K(2018)The Visual Looming Navigation CueComputer Vision and Image Understanding10.1006/cviu.2000.086279:3(331-363)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1006/cviu.2000.0862
Suen PHealey G(2000)The Analysis and Recognition of Real-World Textures in Three DimensionsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/34.85700522:5(491-503)Online publication date: 1-May-2000
https://dl.acm.org/doi/10.1109/34.857005

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents