research-article

A Three-Frame Algorithm for Estimating Two-Component Image Motion

Authors:

James R. Bergen,

Rajesh Hingorani,

Shmeul PelegAuthors Info & Claims

IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 14, Issue 9

Pages 886 - 896

https://doi.org/10.1109/34.161348

Published: 01 September 1992 Publication History

Abstract

A fundamental assumption made in formulating optical-flow algorithms, that motion at any point in an image can be represented as a single pattern component undergoing a simple translation, fails for a number of situations that commonly occur in real-world images. An alternative formulation of the local motion assumption in which there may be two distinct patterns undergoing coherent (e.g. affine) motion within a given local analysis region is proposed. An algorithm for the analysis of two-component motion in which tracking and nulling mechanisms applied to three consecutive image frames separate and estimate the individual components is given. Precise results are obtained, even for components that differ only slightly in velocity as well as for a faint component in the presence of a dominant, masking component. The algorithm provides precise motion estimates for a set of elementary two-motion configurations and is robust in the presence of noise.

References

[1]

{1} G. Adiv, "Determining three-dimensional motion and structure from optical flow generated by several moving objects," IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-7, no. 4, pp. 384-401, July 1985.

Digital Library

[2]

{2} P. Anandan, "A unified perspective on computational techniques for the measurement of visual motion," in Proc. Int. Conf Comput. Vision (London), May 1987, pp. 219-230.

[3]

{3} J. R. Bergen and E. H. Adelson, "Hierarchical, computationally efficient motion estimation algorithm," J. Opt. Soc. Amer. A., vol. 4, p. 35, 1987.

[4]

{4} P. J. Burt, "Fast filter transforms for image processing," Comput. Graphics Image Processing, vol. 16, pp. 20-51, 1981.

[5]

{5} P. J. Burt et al., "Object tracking with a moving camera, An application of dynamic motion analysis," in Proc. IEEE Workshop Visual Motion (Irvine, CA), Mar. 1989, pp. 2-12.

[6]

{6} P. J. Burt, C. Yen, and X. Xu, "Multi-resolution flow-through motion analysis," in Proc. IEEE Conf. Comput. Vision Patt. Recogn. (Washington, DC), June 1983, pp. 246-252.

[7]

{7} C. L. Fennema and W. B. Thompson, "Velocity determination in scenes containing several moving objects," Comput. Graphics Image Processing, vol. 9, pp. 301-315, 1979.

[8]

{8} S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-6, pp. 721-741, Nov. 1984.

Digital Library

[9]

{9} B. Girod and D. Kuo, "Direct estimation of displacement histograms," in Proc. Image Understanding Machine Vision Opt. Soc. Amer. (Cape Cod), June 1989, pp. 73-76.

[10]

{10} D. J. Heeger, "Optical flow using spatiotemporal filters," Int. J. Comput. Vision, vol. 1, pp. 279-302, 1988.

[11]

{11} E. C. Hildreth, The Measurement of Visual Motion. Cambridge, MA: MIT Press, 1983.

[12]

{12} B. K. P. Horn, Robot Vision. Cambridge, MA: MIT Press, 1986.

[13]

{13} B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artificial Intell., vol. 17, pp. 185-203, 1981.

Digital Library

[14]

{14} B. K. P. Horn and E. J. Weldon, "Direct methods for recovering motion," Int. J. Comput. Vision, vol. 2, no. 1, pp. 51-76, June 1988.

[15]

{15} D. Keren, S. Peleg, and R. Brada, "Image sequence enhancement using sub-pixel displacements," in Proc. IEEE Conf. Comput. Vision Patt. Recogn. (Ann Arbor, MI), pp. 742-746, June 1988.

[16]

{16} J. O. Limb and J. A. Murphy, "Estimating the velocity of moving images in television signals," Comput. Graphics Image Processing, vol. 4, no. 4, pp. 311-327, Dec. 1975.

[17]

{17} B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Image Understanding Workshop, 1981, pp. 121-130.

[18]

{18} D. W. Murray and B. F. Buxton, "Scene segmentation from visual motion using global optimization," IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-9, no. 2, pp. 220-228, Mar. 1987.

Digital Library

[19]

{19} T. Pavlidis, Structural Pattern Recognition. New York: Springer, 1977.

[20]

{20} S. Peleg and H. Rom, "Motion based segmentation," in Proc. Int. Conf. Patt. Recogn. (Atlantic City, NJ), June 1990, pp. 109-113, vol. 1.

[21]

{21} M. Shizawa and K. Mase, "Simultaneous multiple optical flow estimation," in Proc. Int. Conf. Patt. Recogn. (Atlantic City, NJ), June 1990, pp. 274-278.

Cited By

Kopf JLangguth FScharstein DSzeliski RGoesele M(2013)Image-based rendering in the gradient domainACM Transactions on Graphics10.1145/2508363.250836932:6(1-9)Online publication date: 1-Nov-2013
https://dl.acm.org/doi/10.1145/2508363.2508369
Li XHu WShen CZhang ZDick AHengel A(2013)A survey of appearance models in visual object trackingACM Transactions on Intelligent Systems and Technology10.1145/2508037.25080394:4(1-48)Online publication date: 8-Oct-2013
https://dl.acm.org/doi/10.1145/2508037.2508039
Sinha SKopf JGoesele MScharstein DSzeliski R(2012)Image-based rendering for scenes with reflectionsACM Transactions on Graphics10.1145/2185520.218559631:4(1-10)Online publication date: 1-Jul-2012
https://dl.acm.org/doi/10.1145/2185520.2185596
Show More Cited By

Index Terms

A Three-Frame Algorithm for Estimating Two-Component Image Motion
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Animation
      1. Motion capture
      2. Motion processing

Recommendations

Estimating 3D Egomotion from Perspective Image Sequence

The computation of sensor motion from sets of displacement vectors obtained from consecutive pairs of images is discussed. The problem is investigated with emphasis on its application to autonomous robots and land vehicles. The effects of 3D camera ...
3-D Translational Motion and Structure from Binocular Image Flows

Image flow fields from parallel stereo cameras are analyzed to determine the relative 3-D translational motion of the camera platform with respect to objects in view and to establish stereo correspondence of features in the left and right images. A two-...
Learned Models for Estimation of Rigid and ArticulatedHuman Motion from Stationary or Moving Camera

We propose an approach for modeling, measurement and tracking of rigid and articulated motion as viewed from a stationary or moving camera. We first propose an approach for learning temporal-flow models from exemplar image sequences. The temporal-flow ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Pattern Analysis and Machine Intelligence

IEEE Transactions on Pattern Analysis and Machine Intelligence Volume 14, Issue 9

September 1992

98 pages

ISSN:0162-8828

Editor:
Anil K. Jain
Michigan State Univ., East Lansing

Issue’s Table of Contents

Copyright © Copyright © 1992 IEEE. All Rights Reserved.

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 September 1992

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kopf JLangguth FScharstein DSzeliski RGoesele M(2013)Image-based rendering in the gradient domainACM Transactions on Graphics10.1145/2508363.250836932:6(1-9)Online publication date: 1-Nov-2013
https://dl.acm.org/doi/10.1145/2508363.2508369
Li XHu WShen CZhang ZDick AHengel A(2013)A survey of appearance models in visual object trackingACM Transactions on Intelligent Systems and Technology10.1145/2508037.25080394:4(1-48)Online publication date: 8-Oct-2013
https://dl.acm.org/doi/10.1145/2508037.2508039
Sinha SKopf JGoesele MScharstein DSzeliski R(2012)Image-based rendering for scenes with reflectionsACM Transactions on Graphics10.1145/2185520.218559631:4(1-10)Online publication date: 1-Jul-2012
https://dl.acm.org/doi/10.1145/2185520.2185596
Sanches Sda Silva VTori R(2012)Bilayer segmentation augmented with future evidenceProceedings of the 12th international conference on Computational Science and Its Applications - Volume Part II10.1007/978-3-642-31075-1_52(699-711)Online publication date: 18-Jun-2012
https://dl.acm.org/doi/10.1007/978-3-642-31075-1_52
Licsár ASzirányi TCzúni L(2010)Trainable blotch detection on high resolution archive films minimizing the human interactionMachine Vision and Applications10.1007/s00138-007-0106-y21:5(767-777)Online publication date: 1-Aug-2010
https://dl.acm.org/doi/10.1007/s00138-007-0106-y
Kaftory RZeevi Y(2009)Blind separation of position varying mixed imagesProceedings of the 16th IEEE international conference on Image processing10.5555/1819298.1819807(3869-3872)Online publication date: 7-Nov-2009
https://dl.acm.org/doi/10.5555/1819298.1819807
Kim DLee GHoward DKang JSlezak DAhn TYang C(2009)Smoke detection using boundary growing and momentsProceedings of the 2009 International Conference on Hybrid Information Technology10.1145/1644993.1645072(430-433)Online publication date: 27-Aug-2009
https://dl.acm.org/doi/10.1145/1644993.1645072
Dewan MHossain MChae O(2008)An adaptive motion segmentation for automated video surveillanceEURASIP Journal on Advances in Signal Processing10.1155/2008/1874132008(1-13)Online publication date: 1-Jan-2008
https://dl.acm.org/doi/10.1155/2008/187413
Szeliski R(2006)Image alignment and stitchingFoundations and Trends® in Computer Graphics and Vision10.1561/06000000092:1(1-104)Online publication date: 1-Jan-2006
https://dl.acm.org/doi/10.1561/0600000009
Tsin YKang SSzeliski R(2006)Stereo Matching with Linear Superposition of LayersIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2006.4228:2(290-301)Online publication date: 1-Feb-2006
https://dl.acm.org/doi/10.1109/TPAMI.2006.42
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents