Abstract
We propose a recursive post-processing algorithm to improve feature-maps, like disparity- or motion-maps, computed by early vision modules. The statistical distribution of the features is computed from the original feature-map, and from this the most likely candidate for a correct feature is determined for every pixel. This process is performed automatically by a clustering algorithm which determines the feature candidates as the cluster centres in the distribution. After determining the feature candidates, a cost function is computed for every pixel, and a candidate will only replace the original feature if the cost is reduced. In this way, a new feature-map is generated which, in the next iteration, serves as the basis for the computation of the updated feature distribution. Iterations are stopped if the total cost reduction is less than a pre-defined threshold. In general, our technique is albe to reduce two of the most common problems that affect feature-maps, the sparseness, i.e. the presence of areas where the algorithm is not able to give meaningful measurements, and the blur. To show the efficacy of our approach, we apply the reclustering algorithm to several examples of increasing complexity, showing results for synthetic and natural images.
Similar content being viewed by others
References
Marr D. Vision. Freeman, 1982
Barnard S and Fischler M. Computational stereo. ACM Computer Surveys 1982; 14(4): 553–572
Dhond UR, Aggarwal JK. Structure from stereo: A review. IEEE Transaction on Man, Machine and Cybernetics 1989; 19(6): 1489–1510
Haralick RM, Shapiro LG. Computer and Robot Vision, volume 2. Addison-Wesley, 1992
Horn BKP, Schunck BG. Determining optical flow. Artificial Intelligence 1981; 17: 185–203
Lucas BD, Kanade T. An iterative image registration technique with an application to stereo vision. Proceedings DARPA81 1981; 121–130
Nagel HH. On the estimation of optical flow: Relations between different approaches and some new results. Artificial Intelligence 1987; 33(3): 299–324
Anandan P. A computational framework and an algorithm for the measurement of visual motion. International Journal of Computer Vision 1989; 2: 283–310
Barron JL, Fleet D, Beauchemin S. Performance of optical flow techniques. International Journal of Computer Vision 1994; 12(1): 43–77
Poggio TA, Torre V, Koch C. Computational vision and regularization theory. Nature 1985; 317: 314–319
Ghosal S, Vanek P. A fast scalable algorithm for discontinuous optical-flow estimation. IEEE Trans PAMI 1996; 18(2): 181–194
Szeliski R, Coughlan J. Spline-based image registration. Technical Report CRL 91/1, DEC Cambridge Research Laboratory, April 1994
Li SZ. Markov Random Field Modeling in Computer Vision. Springer-Verlag, 1995
Fleet D, Jepson A, Jenkin M. Phase-based disparity measurement. Computer Vision, Graphic and Image Process 1991; 53(2): 198–210
Lucas BD, Kanade T. Optical navigation by the method of differences. Proceedings DARPA84 1984; 272–281
Maybeck PS. Stochastic Models, Estimation, and Control, volume 1. Academic Press, 1979
Rosenfeld A, Davis LS. Image segmentation and image models. Proceedings of IEEE 1979; 67: 764–772
Haralick RM, Shapiro LG. Image segmentation techniques. Computer Vision, Graphic and Image Process 1985; 29(1): 100–132
Coleman G, Andrews HC. Image segmentation and clustering. Proceedings IEEE 1979; 67(5): 773–785
Jolion JM, Meer P, Bataouche S. Robust clustering with applications in computer vision. IEEE Trans PAMI 1991; 13(8): 791–802
Wang JY, Adelson FH, Desai U. Applying mid-level vision techniques for video data compression and manipulation. Proc SPIE: Digital Video Compression on Personal Computers: Algorithms and Technologies, San Jose, CA, February 1994
Black MJ, Jepson AD. Estimating optical-flow in segmented images using variable-order parametric models with local deformations. IEEE Trans PAMI 1996; 18(10): 972–986
Huber PJ. Robust Statistics. John Wiley & Sons, 1981
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cozzi, A., Wörgötter, F. Reclustering techniques improve early vision feature maps. Pattern Analysis & Applic 1, 42–51 (1998). https://doi.org/10.1007/BF01238025
Received:
Revised:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01238025