Abstract
Segmentation of range images has long been considered in computer vision as an important but extremely difficult problem. In this paper we present a new paradigm for the segmentation of range images into piecewise continuous surfaces. Data aggregation is performed via model recovery in terms of variable-order bi-variate polynomials using iterative regression. Model recovery is initiated independently in regularly placed seed regions in the image. All the recovered models are potential candidates for the final description of the data. Selection of the models is defined as a quadratic Boolean problem, and the solution is sought by the WTA (winner-takes-all) technique, which turns out to be a good compromise between the speed of computation and the accuracy of the solution. The overall efficiency of the method is achieved by combining model recovery and model selection in an iterative way. Partial recovery of the models is followed by the selection (optimization) procedure and only the “best” models are allowed to develop further.
The major novelty of the approach lies in an effective combination of simple component algorithms, which stands in contrast to methods which attempt to solve the problem in a single processing step using sophisticated means. We present the results on several real range images.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Ackley, D.H. 1987.Stochastic Iterated Genetic Hillclimbing. PhD thesis, Department of Computer Science, Carnegie Mellon University.
Asada, H. and Brady, M. 1986. The curvature primal sketch.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8(1):2–14.
Bajcsy, R. 1988. Active perception.Proceedings of the IEEE, 76(8):996–1005.
Bajcsy, R., Solina, F., and Gupta, A. 1990. Segmentation versus object representation-Are they separable? In Jain, R. and Jain, A.K., editors,Analysis and Interpretation of Range Images. Springer-Verlag: New York.
Besl, P.J. 1988.Surfaces in Range Image Understanding. Springer-Verlag: New York.
Besl, P.J., Birch, J.B., and Watson, L.T. 1988. Robust window operators. InProceedings of the 2nd International Conference on Computer Vision, Tampa, FL, pp. 591–600.
Besl, P.J. and Jain, R.C. 1985. Three-dimensional object recognition.ACM Computing Surveys, 17(1):75–145.
Besl, P.J. and Jain, R.C. 1986. Invariant surface characteristics for three-dimensional object recognition in range images.Computer Vision, Graphics, and Image Processing, 33(1):33–80.
Besl, P.J. and Jain, R.C. 1988. Segmentation through variable-order surface fitting.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-10(2):167–192.
Binford, T.O. 1982. Survey of model-based image analysis systems. International Journal of Robotics Research, 1(1):18–64.
Blake, A. and Zisserman, A. 1987.Visual Reconstruction. The MIT Press: Cambridge, Massachusetts.
Bolle, R.M. and Vermuri, B.C. 1991. On three-dimensional surface reconstruction methods.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-13(1):1–13.
Brady, M. 1983. Criteria for representations of shape. In Beck, J., Hope, B., and Rosenfeld, A., editors,Human and Machine Vision. Academic Press: New York.
Brady, M., Ponce, J., Yuille, A., and Asada, H. 1985. Describing surfaces.Computer Vision, Graphics, and Image Processing, 32(1):1–28.
Chen, D.S. 1989. A data-driven intermediate level feature extraction algorithm.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-11(7):749–758.
Cherkassky, D. 1991. Implementation of algorithms on the Connection Machine. In GRASP News, Vol. 7, No. 1. University of Pennsylvania, Philadelphia, PA. MS-CIS-91-20, GRASP LAB 256.
Fan, T.J. 1988.Describing and Recognizing 3-D Objects Using Surface Properties. PhD thesis, University of Southern California. Technical report IRIS 237.
Faugeras, O.D. and Hebert, M. 1986. The representation, recognition, and locating of 3-D objects.The International Journal of Robotics Research, 5(3):27–52.
Feldman, J.A. 1982. Dynamic connections in neural networks.Biological Cybernetics, 46:27–39.
Fua, P. and Hanson, A.J. 1989. Objective functions for feature discrimination. InProceedings of the 11th International Joint Conference on Artificial Intelligence, Detroit, MI, pp. 1596–1602.
Godin, G.D. and Levine, M.D. 1989. Structured edge map of Curved objects in a range image. InProceedings of Conference on Computer Vision and Pattern Recognition, San Diego, CA, pp. 276–281.
Gupta, A. and Bajcsy, R. 1993. Volumetric segmentation of range images of 3-D objects using superquadrics.Computer Vision, Graphics, and Image Processing: Image Understanding, 58(3): 302–326.
Hochberg, J. 1981. Levels of perceptual organization. In Kubovy, M. and Pomerantz, J.R., editors,Perceptual Organization. Lawrence Erlbaum Associates: New Jersey. pp. 255–276.
Hoffman, R. and Jain, A.K. 1987. Segmentation and classification of range images.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-9(5):608–620.
Hopfield, J.J. and Tank, D.W. 1985. “Neural” computation of decisions in optimization problems.Biological Cybernetics, 52:141–152.
Horowitz, S.L. and Pavlidis, T. 1974. Picture segmentation by a directed split-and-merge procedure. InProceedings of the 2nd International Joint Conference on Pattern Recognition, pp. 424–433.
Jain, R.C. and Binford, T.O. 1991. Ignorance, myopia, and naivete in computer vision systems.Computer Vision, Graphics, and Image Processing: Image Understanding, 53(1):112–117.
Kirkpatrick, S., Gelatt, C.D., and Vecchi, M.P. 1983. Optimization by simulated annealing.Science, 220:671–680.
Koch, C. and Ullman, S. 1984. Selecting one among many: A simple network implementing shifts in selective visual attention. Technical Report A.I. Memo 770, C.B.I.P. Paper 3, Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA.
Leclerc, Y.G. 1989. Constructing simple stable descriptions for image partitioning.International Journal of Computer Vision, 3:73–102.
Leonardis, A. 1993.Image Analysis Using Parametric Models: Model-Recovery and Model-Selection Paradigm. PhD thesis, Faculty of Electrical Engineering and Computer Science, University of Ljubljana, Slovenia. Technical Report LRV-93-3.
Leonardis, A. and Bajcsy, R. 1992. Finding parametric curves in an image. In Sandini, G., editor,Proceedings of The Second European Conference on Computer Vision—ECCV-92, Santa Margherita Ligure, Italy, pp. 653–657. Springer-Verlag. Lecture Notes in Computer Science, LNCS-Series Vol. 588.
Leonardis, A., Solina, E., and Macerl, A. 1994. A direct recovery of superquadric models in range images using recover-and-select paradigm. In Eklundh J.-O., ed.,Proceedings of The Third European Conference on Computer Vision-ECCV-94, Stockholm, Sweden. Springer-Verlag. Lecture Notes in Computer Science, LNCS - Series vol. 800.
Li, G. 1985. Robust regression. In Hoaglin, D.C., Mosteller, E., and Tukey, J.W., editors,Exploring Data Tables, Trends and Shapes. Wiley: New York. pp. 281–343.
Liang, P. and Todhunter, J.S. 1990. Representation and recognition of surface shapes in range images: A differential geometry approach.Computer Vision, Graphics, and Image Processing, 52(1):78–109.
Marr, D. 1982.Vision. Freeman: San Francisco, CA.
Mumford, D. and Shah, J. 1985. Boundary detection by minimizing functionals, I. InProc. IEEE Comp. Soc. Conf. Computer Vision and Pattern Recognition, San Francisco, CA, pp. 22–26.
Nackman, L.R. 1984. Two-dimensional critical point configuration graphs.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-6(4):442–449.
Pentland, A.R. 1989. Part segmentation for object recognition.Neural Computation, 1:82–91.
Pentland, A.R. 1990. Automatic extraction of deformable part models.International Journal of Computer Vision, 4:107–126.
Poggio, T., Torre, V., and Koch, C. 1985. Computational vision and regularization theory.Nature, 317:314–319.
Ponce, J. and Brady, M. 1985. Toward a surface primal sketch. In Kanade, T., editor, Three Dimensional Vision. Academic Press: New York.
Rissanen, J. 1984. Universal coding, information, prediction, and estimation.IEEE Transactions on Information Theory, 30:629–636.
Sander, P.T. and Zucker, S. 1988. Inferring differential structure from 3-D images: Smooth cross sections of fibre bundles. McGill University, Canada, Technical Report TR-CIM-88-6.
Seber, G. A.F. 1977.Linear Regression Analysis. Wiley: New York. Chapter 11.
Smith, D.R. and Kanade, T. 1985. Autonomous scene description with range imagery.Computer Vision, Graphics, and Image Processing, 31(3):322–334.
Terzopoulos, D. 1986. Regularization of inverse visual problems involving discontinuities.IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8(4):413–424.
Zucker, S.W. 1976. Region growing: childhood and adolescence.Computer Graphics and Image Processing, 5:382–399.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Leonardis, A., Gupta, A. & Bajcsy, R. Segmentation of range images as the search for geometric parametric models. Int J Comput Vision 14, 253–277 (1995). https://doi.org/10.1007/BF01679685
Received:
Revised:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01679685