Abstract
This paper presents a theory for constructing and computing velocity-adapted scale-space filters for spatio-temporal image data. Starting from basic criteria in terms of time-causality, time-recursivity, locality and adaptivity with respect to motion estimates, a family of spatio-temporal recursive filters is proposed and analysed. An important property of the proposed family of smoothing kernels is that the spatio-temporal covariance matrices of the discrete kernels obey similar transformation properties under Galilean transformations as for continuous smoothing kernels on continuous domains. Moreover, the proposed theory provides an efficient way to compute and generate non-separable scale-space representations without need for explicit external warping mechanisms or keeping extended temporal buffers of the past. The approach can thus be seen as a natural extension of recursive scale-space filters from pure temporal data to spatio-temporal domains.
The support from the Swedish Research Council for Engineering Sciences, TFR, and from the Royal Swedish Academy of Sciences as well as the Knut and Alice Wallenberg Foundation is gratefully acknowledged.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Adelson, E. & Bergen, J. (1985), ‘Spatiotemporal energy models for the perception of motion’, JOSA A 2, 284–299.
Almansa, A. & Lindeberg, T. (2000), ‘Fingerprint enhancement by shape adaptation of scale-space operators with automatic scale-selection’, IEEE-TIP 9(12), 2027–2042.
Ballester, C. & Gonzalez, M. (1998), ‘Affine invariant texture segmentation and shape from texture by variational methods’, J. Math. Im. Vis. 9, 141–171.
Burt, P. J. (1981), ‘Fast filter transforms for image processing’, CVGIP 16, 20–51.
Crowley, J. L. (1981), A Representation for Visual Information, PhD thesis, Carnegie-Mellon University, Pittsburgh, Pennsylvania.
DeAngelis, G. C., Ohzawa, I. & Freeman, R. D. (1995), ‘Receptive field dynamics in the central visual pathways’, Trends in Neuroscience 18(10), 451–457.
Deriche, R. (1987), ‘Using Canny’s criteria to derive a recursively implemented optimal edge detector’, IJCV 1, 167–187.
Fleet, D. J. & Langley, K. (1995), ‘Recursive filters for optical flow’, IEEE-PAMI 17(1), 61–67.
Florack, L. M. J. (1997), Image Structure, Kluwer, Netherlands.
Florack, L., Niessen, W. & Nielsen, M. (1998), ‘The intrinsic structure of optic flow incorporating measurement duality’, IJCV 27(3), 263–286.
Freeman, W. T. & Adelson, E. H. (1991), “The design and use of steerable filters’, IEEE-PAMI 13(9), 891–906.
Guichard, F. (1998), ‘A morphological, affine, and galilean invariant scale-space for movies’, IEEE Trans. Image Processing 7(3), 444–456.
Heeger, D. (1988), ‘Optical flow using spatiotemporal filters’, IJCV 1, 279–302.
Koenderink, J. J. (1984), ‘The structure of images’, Biol. Cyb. 50, 363–370.
Koenderink, J. J. (1988), ‘Scale-time’, Biol. Cyb. 58, 159–162.
Laptev, I. & Lindeberg, T. (2002), Velocity-adaption for direct recognition of activities using multi-scale spatio-temporal receptive field responses. Technical report ISRN KTH/NA/P-02/04-SE, KTH, Stockholm, Sweden.
Lindeberg, T. (1994), Scale-Space Theory in Computer Vision, Kluwer, Netherlands.
Lindeberg, T. (1997), Linear spatio-temporal scale-space, in ‘Proc. Scale-Space’97’, Utrecht, Netherlands, Vol. 1252 of Springer LNCS, pp. 113–127.
Lindeberg, T. (2001), Linear spatio-temporal scale-space, report, ISRN KTH/NA/P-01/22-SE, KTH, Stockholm, Sweden.
Lindeberg, T. & Fagerström, D. (1996), Scale-space with causal time direction, in ‘ECCV’96’, Vol. 1064, pp. 229–240.
Lindeberg, T. & Gårding, J. (1997), ‘Shape-adapted smoothing in estimation of 3-D depth cues from affine distortions of local 2-D structure’, IVC 15, 415–434.
Nagel, H. & Gehrke, A. (1998), Spatiotemporal adaptive filtering for estimation and segmentation of optical flow fields, in ECCV’98, Freiburg, Germany, pp. 86–102.
Schaffalitzky, F. & Zisserman, A. (2001), Viewpoint invariant texture matching and wide baseline stereo, in Proc. ICCV’01, Vancouver, Canada.
Simoncelli, E. & Heeger, D. (1998), ‘A model of neuronal responses in visual area MT’, Vis. Res. 38(5).
ter Haar Romeny, B., Florack, L. & Nielsen, M. (2001), Scale-time kernels and models, in Scale-Space’01, Vancouver, Canada.
Valois, R. L. D., Cottaris, N. P., Mahon, L. E., Elfer, S. D. & Wilson, J. A. (2000), ‘Spatial and temporal receptive fields of geniculate and cortical cells and directional selectivity’, Vis. Res. 40(2), 3685–3702.
Watson, A. & Ahumada, A. (1985), ‘Model of human visual-motion sensing’, JOSA 2(2), 322–341.
Weickert, J. (1998), Anisotropic Diffusion in Image Processing, Teubner-Verlag.
Witkin, A. P. (1983), Scale-space filtering, in ‘8th IJCAI’, Karlsruhe, Germany, pp. 1019–1022.
Young, R. A. (1987), ‘The Gaussian derivative model for spatial vision: I. Retinal mechanisms’, Spatial Vision 2, 273–293.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lindeberg, T. (2002). Time-Recursive Velocity-Adapted Spatio-Temporal Scale-Space Filters. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds) Computer Vision — ECCV 2002. ECCV 2002. Lecture Notes in Computer Science, vol 2350. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47969-4_4
Download citation
DOI: https://doi.org/10.1007/3-540-47969-4_4
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43745-1
Online ISBN: 978-3-540-47969-7
eBook Packages: Springer Book Archive