research-article

The Computation of Visible-Surface Representations

Author:

Demetri TerzopoulosAuthors Info & Claims

IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 10, Issue 4

Pages 417 - 438

https://doi.org/10.1109/34.3908

Published: 01 July 1988 Publication History

Abstract

A computational theory of visible-surface representations is developed. The visible-surface reconstruction process that computes these quantitative representations unifies formal solutions to the key problems of: (1) integrating multiscale constraints on surface depth and orientation from multiple-visual sources; (2) interpolating dense, piecewise-smooth surfaces from these constraints; (3) detecting surface depth and orientation discontinuities to apply boundary conditions on interpolation; and (4) structuring large-scale, distributed-surface representations to achieve computational efficiency. Visible-surface reconstruction is an inverse problem. A well-posed variational formulation results from the use of a controlled-continuity surface model. Discontinuity detection amounts to the identification of this generic model's distributed parameters from the data. Finite-element shape primitives yield a local discretization of the variational principle. The result is an efficient algorithm for visible-surface reconstruction.

References

[1]

{1} M. Abramowitz and I. A. Stegun, Ed., Handbook of Mathematical Functions. New York: Dover, 1965.

Digital Library

[2]

{2} H. G. Barrow and J. M. Tenenbaum, "Recovering intrinsic scene characteristics from images," in Computer Vision Systems, A. Hanson and E. Riseman, Eds. New York: Academic, 1978, pp. 3-26.

[3]

{3} H. G. Barrow and J. M. Tenenbaum, "Reconstructing smooth surfaces from partial, noisy information," in Proc. DARPA Image Understanding Workshop, L. S. Baumann, Ed., Univ. Southern California, 1979, pp. 76-86.

[4]

{4} H. G. Barrow and J. M. Tenenbaum, "Interpreting line drawings as three-dimensional surfaces," Artificial Intell., vol. 17, pp. 75-116, 1981.

Digital Library

[5]

{5} P. J. Besl and R. C. Jain, "Invariant surface characteristics for three-dimensional object recognition in range images," Comput. Vision, Graphics, Image Processing, vol. 33, pp. 33-80, 1986.

Digital Library

[6]

{6} A. Blake, "The least-disturbance principle and weak constraints," tern Recognition Lett., vol. 1, pp. 393-399, 1983.

[7]

{7} A. Blake, "Reconstructing a visible surface," in Proc. Nat. Conf. AI (AAAI-84), Austin, TX, 1984, pp. 23-26.

[8]

{8} A. Blake and A. Zisserman, "Invariant surface reconstruction using weak continuity constraints," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Miami, FL, 1986, pp. 62-67.

[9]

{9} G. Bolondi, F. Rocca, and S. Zanoletti, "Automatic contouring of faulted subsurfaces," Geophys., vol. 41, pp. 1377-1393, 1976.

[10]

{10} T. E. Boult and J. R. Kender, "Visual surface reconstruction using sparse depth data," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Miami, FL, 1986, pp. 68-76.

[11]

{11} O. J. Braddick, F. W. Campbell, and J. Atkinson, "Channels in vision: Basic aspects," in Handbook of Sensory Physiology: Perception , vol. 8, R. Held, H. W. Leibowitz, and H. L. Teuber, Eds. Berlin: Springer, 1978, pp. 3-38.

[12]

{12} J. M. Brady and B. K. P. Horn, "Rotationally symmetric operators for surface interpolation," Comput. Vision, Graphics, Image Processing , vol. 22, pp. 70-94, 1983.

[13]

{13} J. M. Brady, J. Ponce, A. Yuille, and H. Asada, "Describing surfaces," Comput. Vision, Graphics, Image Processing, vol. 32, pp. 1-28, 1985.

[14]

{14} I. C. Briggs, "Machine contouring using minimum curvature," Geophys. , vol. 39, pp. 39-48, 1974.

[15]

{15} P. Burt and B. Julesz, "A disparity gradient limit for binocular fusion," Science, vol. 208, pp. 615-617, 1980.

[16]

{16} G. Chavent, "Identification of distributed parameters," in IFAC Symp. Identification and System Parameter Estimation. New York: American Elsevier, 1973.

[17]

{17} F. H. Clarke, Optimization and Nonsmooth Analysis. New York: Wiley-Interscience, 1983.

[18]

{18} T. S. Collett, "Extrapolating and interpolating surfaces in depth," Proc. Roy. Soc. London B, vol. 224, pp. 43-56, 1985.

[19]

{19} S. Cochran and M.-M. Medioni, "Implementation of a multiresolution surface reconstruction algorithm," Dep. Elec. Eng. and Comput. Sci., Univ. Southern California, Los Angeles, Rep. ISG-108, 1985.

[20]

{20} M. P. do Carmo, Differential Geometry of Curves and Surfaces. Englewood Cliffs, NJ: Prentice-Hall, 1976.

[21]

{21} Y. M. Ermoliev, "Methods of nondifferentiable and stochastic optimization and their applications," in Progress in Nondifferentiable Optimization , E. A. Nurminski, Ed., Int. Inst. Appl. Syst. Anal., Laxenburg, Austria, 1982.

[22]

{22} T. J. Fan, G. Medioni, and R. Nevatia, "Description of surfaces from range data," in Proc. DARPA Image Understanding Workshop, Miami Beach, FL, L. S. Baumann, Ed., 1985, pp. 232-244.

[23]

{23} R. Franke, "Thin plate splines with tension," Comput. Aided Geometric Design, vol. 2, pp. 87-95, 1985.

Digital Library

[24]

{24} R. Franke and G. M. Neilson, "Surface approximation with imposed conditions," in Surfaces in Computer Aided Geometric Design, R. E. Barnhill and W. Boehm, Eds. Amsterdam, The Netherlands: North-Holland, 1983, pp. 135-146.

[25]

{25} S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 721-741, 1985.

Digital Library

[26]

{26} J. J. Gibson, The Perception of the Visual World. Boston, MA: Houghton Mifflin, 1950.

[27]

{27} W. E. L. Grimson, From Images in Surfaces: A Computational Study of the Human Early Visual System. Cambridge, MA: MIT Press, 1981.

Digital Library

[28]

{28} W. E. L. Grimson, "An implementation of a computational theory of visual surface interpolation," Comput. Vision, Graphics, Image Processing, vol. 22, pp. 39-69, 1983.

[29]

{29} W. E. L. Grimson, "Computational experiments with a feature based stereo algorithm," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 17-34, 1985.

Digital Library

[30]

{30} W. E. L. Grimson and T. Pavlidis, "Discontinuity detection for visual surface reconstruction," Comput. Vision, Graphics, Image Processing , vol. 30, pp. 316-330, 1985.

[31]

{31} W. Hackbusch, Multi-Grid Methods and Applications. Berlin: Springer-Verlag, 1985.

[32]

{32} L. A. Hageman and D. M. Young, Applied Iterative Methods. New York: Academic, 1981.

[33]

{33} J. G. Harris, "The coupled depth/slope approach to surface reconstruction," M.S. thesis, Dep. Elec. Eng. Comput. Sci., MIT, Cambridge, MA, 1986.

[34]

{34} B. K. P. Horn, "Sequins and quills--A representation for surface topography," in Representation of Three-Dimensional Objects, R. Bajcsy, Ed. New York: Springer-Verlag, 1982.

[35]

{35} W. J. Karplus, Analog Simlulation: Solution of Field Problems. New York: McGraw-Hill, 1958.

[36]

{36} M. Kass, "Computing visual correspondence," in From Pixels to Predicates, A. P. Pentland, Ed. Norwood, NJ: Ablex, 1986, pp. 78-92.

[37]

{37} C. Koch, J. L. Marroquin, and A. L. Yuille, "Analog "neuronal" networks in early vision," Proc. Nat. Acad. Sci., p. 4263, 1986.

[38]

{38} D. J. Langridge, "Detection of discontinuities in the first derivatives of surfaces," Comput. Vision, Graphics, Image Processing, vol. 27, pp. 291-308, 1984.

[39]

{39} Y. Leclerc and S. W. Zucker, "The local structure of image discontinuities in one dimension," IEEE Trans. Pattern Anal. Machine Intell. , vol. PAMI-9, pp. 341-355, 1987.

Digital Library

[40]

{40} D. Marr, Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. San Francisco, CA: Freeman, 1982.

Digital Library

[41]

{41} D. Marr and H. K. Nishihara, "Representation and recognition of the spatial organization of three-dimensional shapes," Proc. Roy. Soc. London B, vol. 200, 1978, pp. 269-294.

[42]

{42} J. L. Marroquin, "Surface reconstruction preserving discontinuities," MIT A.I. Lab., Cambridge, MA, AI Memo 792, 1984.

Digital Library

[43]

{43} D. Mumford and J. Shah, "Boundary detection by minimizing functionals, I," in Proc. IEEE Conf. Computer Vision and Pattern Recognition , San Francisco, CA, 1985, pp. 22-26.

[44]

{44} T. Poggio, V. Torre, and C. Koch, "Computational vision and regularization theory," Nature, vol. 317, pp. 314-319, 1985.

Digital Library

[45]

{45} M. P. Polis and R. E. Goodson, "Parameter identification in distributed systems: A synthesizing overview," Proc. IEEE, vol. 64, pp. 45-61, 1976.

[46]

{46} R. T. Rockafellar, The Theory of Subgradients and its Application to Problems of Optimization: Convex and Nonconvex Functions. Berlin: Helderman Verlag, 1981.

[47]

{47} L. L. Schumaker, "Fitting surfaces to scattered data," in Approximation Theory II, G. G. Lorentz, C. K. Chui, and L. L. Schumaker, Eds. New York: Academic, 1976, pp. 203-267.

[48]

{48} J. H. Shiau, "Smoothing spline estimation of functions with discontinuities," Ph.D. dissertation, Dep. Statistics, Univ. Wisconsin, Madison, 1985.

[49]

{49} G. Strang and G. J. Fix, An Analysis of the Finite Element Method. Englewood Cliffs, NJ: Prentice-Hall, 1973.

[50]

{50} R. Szilard, Theory and Analysis of Plates: Classical and Numerical Methods. Englewood Cliffs, NJ: Prentice-Hall, 1974.

[51]

{51} D. Terzopoulos, "Multilevel computational processes for visual surface reconstruction," Comput. Vision, Graphics, Image Processing, vol. 24, pp. 52-96, 1983.

[52]

{52} D. Terzopoulos, "The role of constraints and discontinuities in visible-surface reconstruction," in Proc. 8th Int. Joint Conf. AI, Karlsruhe, W. Germany, 1983, pp. 1073-1077.

[53]

{53} D. Terzopoulos, "Multiresolution computation of visible surface representations," Ph.D. dissertation, Dep. Elec. Eng. Comput. Sci., MIT, Cambridge, MA, Jan. 1984.

[54]

{54} D. Terzopoulos, "Concurrent multilevel relaxation," in Proc. DARPA Image Understanding Workshop, L. S. Baumann, Ed., Miami Beach, FL, 1985, pp. 156-162.

[55]

{55} D. Terzopoulos, "Image analysis using multigrid relaxation methods," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 129-139, 1986.

Digital Library

[56]

{56} D. Terzopoulos, "Regularization of inverse visual problems involving discontinuities," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 413-424, 1986.

Digital Library

[57]

{57} A. N. Tikhonov and V. A. Arsenin, Solutions of Ill-Posed Problems. Washington, DC: Winston and Sons, 1977.

[58]

{58} V. Torre and T. A. Poggio, "On edge detection," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 147-163, 1986.

Digital Library

[59]

{59} B. C. Vemuri, A. Mitiche, and J. K. Aggarwal, "Curvature-based representation of objects from range data," Image and Vision Computing , vol. 4, pp. 107-114, 1986.

Digital Library

[60]

{60} G. Wahba, "Spline bases, regularization, and generalized cross validation for solving approximation problems with large quantities of noisy data, " in Approximation Theory III, E. W. Cheney, Ed. New York: Academic, 1980, pp. 905-912.

[61]

{61} E. Wasserstrom, "Numerical solutions by the continuation method," SIAM Rev., vol. 15, pp. 89-119, 1973.

Digital Library

[62]

{62} R. J. Woodham, "Analyzing images of curved surfaces," Artificial Intell., vol. 17, pp. 117-140, 1981.

Digital Library

[63]

{63} O. C. Zienkiewicz, The Finite Element Method, 3rd ed. New York: McGraw-Hill, 1979.

[64]

{64} S. W. Zucker, R. A. Hummel, and A. Rosenfeld, "An application of relaxation labeling to line and curve enhancement," IEEE Trans. Comput., vol. C-26, pp. 394-403, 1977.

[65]

{65} S. W. Zucker and P. Parent, "Multiple size operators and optimal curve finding," in Multiresolution Image Processing and Analysis, A. Rosenfeld, Ed. New York: Springer-Verlag, 1984, pp. 200-210.

Cited By

Lin XYang ZZhang XZhang QKrause ABrunskill ECho KEngelhardt BSabato SScarlett J(2023)Continuation path learning for homotopy optimizationProceedings of the 40th International Conference on Machine Learning10.5555/3618408.3619285(21288-21311)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.5555/3618408.3619285
Desbrun MMeyer MSchroder PBarr A(2023)Implicit Fairing of Irregular Meshes using Diffusion and Curvature FlowSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596729(149-156)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596729
Stein OGrinspun EWardetzky MJacobson A(2018)Natural Boundary Conditions for Smoothing in Geometry ProcessingACM Transactions on Graphics10.1145/318656437:2(1-13)Online publication date: 12-May-2018
https://dl.acm.org/doi/10.1145/3186564
Show More Cited By

Index Terms

The Computation of Visible-Surface Representations
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Reconstruction
2. Mathematics of computing
  1. Mathematical analysis
    1. Numerical analysis
      1. Computations in finite fields

Recommendations

Closed-Form Solutions for Physically Based Shape Modeling and Recognition

The authors present a closed-form, physically based solution for recovering a three-dimensional (3-D) solid model from collections of 3-D surface measurements. Given a sufficient number of independent measurements, the solution is overconstrained and ...
Viewpoint Invariant Recovery of Visual Surfaces from Sparse Data

An algorithm for the reconstruction of visual surfaces from sparse data is proposed. An important aspect of this algorithm is that the surface estimated from the sparse data is approximately invariant with respect to rigid transformation of the surface ...
Recovering Three-Dimensional Shape from a Single Image of Curved Objects

An algorithm to recover three-dimensional shape, i.e., surface orientation and relative depth from a single segmented image is presented. It is assumed that the scene is composed of opaque regular solid objects bounded by piecewise smooth surfaces with ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Pattern Analysis and Machine Intelligence

IEEE Transactions on Pattern Analysis and Machine Intelligence Volume 10, Issue 4

July 1988

193 pages

ISSN:0162-8828

Editor:
Bruce D. Shriver

Issue’s Table of Contents

Copyright © Copyright © 1988 IEEE. All Rights Reserved.

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 July 1988

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

79
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lin XYang ZZhang XZhang QKrause ABrunskill ECho KEngelhardt BSabato SScarlett J(2023)Continuation path learning for homotopy optimizationProceedings of the 40th International Conference on Machine Learning10.5555/3618408.3619285(21288-21311)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.5555/3618408.3619285
Desbrun MMeyer MSchroder PBarr A(2023)Implicit Fairing of Irregular Meshes using Diffusion and Curvature FlowSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596729(149-156)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596729
Stein OGrinspun EWardetzky MJacobson A(2018)Natural Boundary Conditions for Smoothing in Geometry ProcessingACM Transactions on Graphics10.1145/318656437:2(1-13)Online publication date: 12-May-2018
https://dl.acm.org/doi/10.1145/3186564
(2015)Optimizing depth estimates from magnetic anomalies using spatial analysis toolsComputers & Geosciences10.1016/j.cageo.2015.07.01884:C(1-9)Online publication date: 1-Nov-2015
https://dl.acm.org/doi/10.1016/j.cageo.2015.07.018
Park SCao YWatson LQuek F(2015)Performance analysis of a novel GPU computation-to-core mapping scheme for robust facet image modelingJournal of Real-Time Image Processing10.1007/s11554-012-0272-710:3(485-500)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1007/s11554-012-0272-7
Lu ZTai YDeng FBen-Ezra MBrown M(2013)A 3D Imaging Framework Based on High-Resolution Photometric-Stereo and Low-Resolution DepthInternational Journal of Computer Vision10.1007/s11263-012-0589-5102:1-3(18-32)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1007/s11263-012-0589-5
Finch MSnyder JHoppe H(2011)Freeform vector graphics with controlled thin-plate splinesACM Transactions on Graphics10.1145/2070781.202420030:6(1-10)Online publication date: 12-Dec-2011
https://dl.acm.org/doi/10.1145/2070781.2024200
Finch MSnyder JHoppe H(2011)Freeform vector graphics with controlled thin-plate splinesProceedings of the 2011 SIGGRAPH Asia Conference10.1145/2024156.2024200(1-10)Online publication date: 12-Dec-2011
https://dl.acm.org/doi/10.1145/2024156.2024200
Hahn JTai XBorok SBruckstein A(2011)Orientation-Matching Minimization for Image Denoising and InpaintingInternational Journal of Computer Vision10.1007/s11263-010-0371-592:3(308-324)Online publication date: 1-May-2011
https://dl.acm.org/doi/10.1007/s11263-010-0371-5
Scholl IAach TDeserno TKuhlen T(2011)Challenges of medical image processingComputer Science - Research and Development10.1007/s00450-010-0146-926:1-2(5-13)Online publication date: 1-Feb-2011
https://dl.acm.org/doi/10.1007/s00450-010-0146-9
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents