Article

Free access

A markerless registration method for augmented reality based on affine properties

Authors:

Kamal Youcef-ToumiAuthors Info & Claims

AUIC '06: Proceedings of the 7th Australasian User interface conference - Volume 50

Pages 25 - 32

Published: 01 January 2006 Publication History

Abstract

This paper presents a markerless registration approach for Augmented Reality (AR) systems based on the Kanade-Lucas-Tomasi (KLT) natural feature tracker and the affine reconstruction and reprojection techniques. First, the KLT tracker is used to track the corresponding feature points in two control images. Next, four planar points are specified in each control image to set up the world coordinate system. The affine reconstruction and reprojection techniques are used to estimate the image projections of these four specified planar points in the live video sequence, and these image projections are used to estimate the camera pose in real time. A primitive approach that illustrates the basic idea is first discussed and a robust method is given to improve the resistance to the noise. Pre-defined markers are not required in the proposed approach. The virtual models can still be registered on the proper positions using the proposed method even if the specified region is occluded during the registration process.

References

[1]

Azuma R., (1997): A Survey of Augmented Reality, Presence, 6(4):355-385.

Digital Library

[2]

Azuma R., Baillot Y., Behringer R., Feiner S., Julier S. and MacIntyre B. (2001): Recent Advances in Augmented Reality, IEEE Computer Graphics and Applications, 21(6):34-47.

Digital Library

[3]

Ong K.C., Teh H.C. and Tan T.S., (1998): Resolving Occlusion in Image Sequence Made Easy, The Visual Computer, 14:153-165.

[4]

Seo Y. and Hong K.S., (2000): Calibration-Free Augmented Reality in Perspective, IEEE Transactions on Visualization and Computer Graphics, 6(4):346-359.

Digital Library

[5]

Kutulakos K.N. and Vallino J.R., (1998): Calibration-Free Augmented Reality, IEEE Transactions on Visualization and Computer Graphics, 4(1):1-20.

Digital Library

[6]

Kato H. and Billinghurst M., (1999): Marker Tracking and HMD Calibration for Video-based Augmented Reality Conferencing System, Proc. of the 2nd IEEE and ACM Int'l Workshop on Augmented Reality, pp. 85-93.

Digital Library

[7]

Zauner J., Haller M. and Brandl A., (2003): Authoring of a Mixed Reality Assembly Instructor for Hierarchical Structures, Proc. of the Second IEEE and ACM Int'l Symposium on Mixed and AugmentedReality, pp. 237-246.

Digital Library

[8]

Frund J., Gausemeier J., Matysczok C. and Radkowski R., (2003) Application Areas of AR-Technology within Automobile Advance Development, Int'l Workshop on Potential Industrial Applications of Mixed and Augmented Reality, pp. 1-7.

[9]

Thomas, B., Close, B.; Donoghue, J., Squires, J., De Bondi, P., Morris, M., Piekarski, W., (2000): ARQuake: an outdoor/indoor augmented reality first person application, The Fourth Int'l Symposium on Wearable Computers, pp. 139- 146.

Digital Library

[10]

Yuan M.L., Ong S.K. and Nee A.Y.C., (2005): Registration Based on Projective Reconstruction Technique for Augmented Reality Systems, IEEE Transactions on Visualization and Computer Graphics, 11(3):254-264.

Digital Library

[11]

Tomasi C. and Kanade T., (1991): Detection and Tracking of Point Features, Carnegie Mellon University Technical Report CMU-CS-91-132.

[12]

Chia K.W., Cheok A.D., and Prince S.J.D., (2002): Online 6 DOF Augmented Reality Registration from Natural Features, Proc. of the Int'l Symposium on Mixed and Augmented Reality, pp. 305-313.

Digital Library

[13]

Comport A.I., Marchand E. and Chaumette F., (2003): A real-time tracker for markerless augmented reality, Proc. of the Second IEEE and ACM Int'l Symposium on Mixed and Augmented Reality, pp. 36-45.

Digital Library

[14]

Vacchetti L., Lepetit V. and Fua P., (2004): Combining edge and texture information for real-time accurate 3D camera tracking, Proc. of the Third IEEE and ACM Int'l Symposium on Mixed and Augmented Reality, pp. 48-56.

Digital Library

[15]

Najafi H., Navab N., and Klinker G., (2004): Automated Initialization for Marker-less Tracking: A Sensor Fusion Approach, Proc. of the Third IEEE and ACM Int'l Symposium on Mixed and Augmented Reality, pp. 79-88.

Digital Library

[16]

Gordon I. and Lowe D.G., (2004): Scene Modelling, Recognition and Tracking with Invariant Image Feature, Proc. of the Third IEEE and ACM Int'l Symposium on Mixed and Augmented Reality, pp. 110-119.

Digital Library

[17]

Koenderink J.J. and van Door A.J., (1991): Affine Structure From Motion, Journal of the Optical Society of America A, 8(2): 377-385.

[18]

Weinshall D. and Tomasi C., (1995): Linear and Incremental Acquisition of Invariant Shape Models from Images Sequence, IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(5):512-517.

Digital Library

[19]

Tomasi C. and Kanade T., (1992): Shape and Motion from Image Steams: a Factorization Method Full Report on the Orthographic Case, Cornell TR 92- 1270 and Carnegie Mellon CMU-CS-92-104.

Digital Library

Cited By

Zhu JPan ZRahardja SWu EThalmann DHuang Z(2008)Occlusion registration in video-based augmented realityProceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry10.1145/1477862.1477875(1-6)Online publication date: 8-Dec-2008
https://dl.acm.org/doi/10.1145/1477862.1477875
Guan TLi LWang C(2007)Registration based on online estimation of trifocal tensors using point and line correspondencesProceedings of the 2nd international conference on Virtual reality10.5555/1770090.1770096(42-51)Online publication date: 22-Jul-2007
https://dl.acm.org/doi/10.5555/1770090.1770096

Index Terms

A markerless registration method for augmented reality based on affine properties
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Reconstruction
      2. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation
    2. Image manipulation
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Analysis of Head Pose Accuracy in Augmented Reality

A method is developed to analyze the accuracy of the relative head-to-object position and orientation (pose) in augmented reality systems with head-mounted displays. From probabilistic estimates of the errors in optical tracking sensors, the uncertainty ...
Registration Using Natural Features for Augmented Reality Systems

Registration is one of the most difficult problems in augmented reality (AR) systems. In this paper, a simple registration method using natural features based on the projective reconstruction technique is proposed. This method consists of two steps: ...
Real-Time Markerless Tracking for Augmented Reality: The Virtual Visual Servoing Framework

Tracking is a very important research subject in a real-time augmented reality context. The main requirements for trackers are high accuracy and little latency at a reasonable cost. In order to address these issues, a real-time, robust, and efficient 3D ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

AUIC '06: Proceedings of the 7th Australasian User interface conference - Volume 50

January 2006

180 pages

ISBN:1920682325

Editor:
Wayne Piekarski

Publisher

Australian Computer Society, Inc.

Australia

Publication History

Published: 01 January 2006

Author Tags

Qualifiers

Article

Conference

AUIC '06

January 16 - 19, 2006

Hobart, Australia

Acceptance Rates

Overall Acceptance Rate 40 of 100 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
919
Total Downloads

Downloads (Last 12 months)56
Downloads (Last 6 weeks)9

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhu JPan ZRahardja SWu EThalmann DHuang Z(2008)Occlusion registration in video-based augmented realityProceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry10.1145/1477862.1477875(1-6)Online publication date: 8-Dec-2008
https://dl.acm.org/doi/10.1145/1477862.1477875
Guan TLi LWang C(2007)Registration based on online estimation of trifocal tensors using point and line correspondencesProceedings of the 2nd international conference on Virtual reality10.5555/1770090.1770096(42-51)Online publication date: 22-Jul-2007
https://dl.acm.org/doi/10.5555/1770090.1770096

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents