Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
SpringerLink
Log in

Augmented Reality Using Uncalibrated Video Sequences

  • Conference paper
  • First Online:
3D Structure from Images — SMILE 2000 (SMILE 2000)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2018))

Abstract

Augmented Reality(AR) aims at merging the real and the virtual in order to enrich a real environment with virtual information. Augmentations range from simple text annotations accompanying real objects to virtual mimics of real-life objects inserted into a real environment. In the latter case the ultimate goal is to make it impossible to differentiate between real and virtual objects. Several problems need to be overcome before realizing this goal. Amongst them are the rigid registration of virtual objects into the real environment, the problem of mutual occlusion of real and virtual objects and the extraction of the illumination distribution of the real environment in order to render the virtual objects with this illumination model. This paper will unfold how we proceeded to implement an Augmented Reality System that registers virtual objects into a totally uncalibrated video sequence of a real environment that may contain some moving parts. The other problems of occlusion and illumination will not be discussed in this paper but are left as future research topics.

Kurt Cornelis and Marc Pollefeys are respectively research assistant and postdoctoral fellow of the Fund for Scientific Research - Flanders(Belgium)(F.W.O. - Vlaanderen)

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. R. Azuma: “A Survey of Augmented Reality.” ACM SIGGRAPH’ 95 Course Notes No. 9-Developing Advanced Virtual Reality Applications, (August 1995)

    Google Scholar 

  2. P. Beardsley, P. Torr and A. Zisserman: “3D Model Acquisition from Extended Image Sequences” Computer Vision-ECCV’96, Lecture Notes in Computer Science, Vol. 1065, Springer-Verlag, pp. 683–695, 1996

    Google Scholar 

  3. M.-O. Berger: “Resolving Occlusion in Augmented Reality: a Contour Based Approach without 3D Reconstruction.”

    Google Scholar 

  4. M.-O Berger, G. Simon, S. Petitjean and B. Wrobel-Dautcourt: “Mixing Synthesis and Video Images of Outdoor Environments: Application to the Bridges of Paris. ” ICPR’96, pp. 90–94, 1996

    Google Scholar 

  5. D. E. Breen, R. T. Whitaker and E. Rose: “Interactive Occlusion and Collision of Real and Virtual Objects in Augmented Reality.” Technical Report ECRC-95-02, ECRC, Munich, Germany, 1995

    Google Scholar 

  6. P. Debevec: “Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography. ” Proceedings SIGGRAPH 98, pp. 189–198, July 1998

    Google Scholar 

  7. P. Debevec, Y. Yu, and G. Borshukov: “Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping.” Technical Report UCB//CSD-98-1003, University of California at Berkeley, 1998

    Google Scholar 

  8. O. Faugeras, Q.-T. Luong and S. Maybank: “Camera self-calibration: Theory and experiments” Computer Vision-ECCV’92, Lecture Notes in Computer Science, Vol. 588, Springer-Verlag, pp. 321–334, 1992

    Google Scholar 

  9. C. Harris and M. Stephens: “A combined corner and edge detector” Fourth Alvey Vision Conference, pp. 147–151, 1988

    Google Scholar 

  10. R. Hartley: “Cheirality invariants” Proc. D.A.R.P.A. Image Understanding Work-shop, pp. 743–753, 1993

    Google Scholar 

  11. R. Hartley and P. Sturm: “Triangulation” Computer Vision and Image Understanding, 68(2):146–157, 1997

    Article  Google Scholar 

  12. M. Fischler and R. Bolles: “RANdom SAmpling Consensus: a paradigm for model fitting with application to image analysis and automated cartography” Commun. Assoc. Comp. Mach., 24:95–381, 1981

    MathSciNet  Google Scholar 

  13. J. D. Foley, A. Van Dam, S. K. Feiner and J. F. Hughes: “Computer Graphics: principles and practice.” Addison-Wesley, Reading, Massachusetts, 1990

    Google Scholar 

  14. A. Fournier: “Illumination Problems in Computer Augmented Reality.” In JournéeINRIA, Analyse/Synthèse d’Images (JASI’94), pp. 1–21, January 1994

    Google Scholar 

  15. P. Jancéne, F. Neyret, X. Provot, J. Tarel, J. Vézien, C. Meilhac and A. Verroust: “RES: Computing the Interactions between Real and Virtual Objects in Video Sequences.”

    Google Scholar 

  16. K. N. Kutulakos and J. Vallino: “Affine Object Representations for Calibration-Free Augmented Reality.“ IEEE Virtual Reality Annual International Symposium (VRAIS), pp. 25–36, 1996

    Google Scholar 

  17. M. Pollefeys: “Self-calibration and metric 3D reconstruction from uncalibrated image sequences” Ph.D. thesis, ESAT-PSI, K.U.Leuven, 1999

    Google Scholar 

  18. M. Pollefeys, R. Koch and L. Van Gool: “Self-Calibration and Metric Reconstruction in spite of Varying and Unknown Internal Camera Parameters” International Journal of Computer Vision, Vol.32, Nr.1, pp. 7–25

    Google Scholar 

  19. I. Sato, Y. Sato and K. Ikeuchi: “Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene.” IEEE Transactions on Visualization and Computer Graphics, Vol.5, No.1, January-March 1999

    Google Scholar 

  20. I. Sato, Y. Sato and K. Ikeuchi: “Illumination Distribution from Brightness in Shadows: Adaptive Estimation of Illumination Distribution with Unknown Reflectance Properties in Shadow Regions.” Proceedings of IEEE International Conference on Computer Vision (ICCV’99), pp. 875–882, September 1999

    Google Scholar 

  21. W. Schroeder, K. Martin and B. Lorensen: “The Visualization Toolkit 2nd edition. ”Prentice Hall, New Jersey, 1998

    Google Scholar 

  22. C. Schütz and H. Hügli: Augmented Reality using Range Images. ” SPIE Photonics West, The Engineering Reality of Virtual Reality 1997, San Jose, 1997

    Google Scholar 

  23. Y. Seo, M. H. Ahn and K. S. Hong: “Video Augmentation by Image-based Rendering under the Perspective Camera Model.“

    Google Scholar 

  24. B. Triggs: “The Absolute Quadric“ Proc. 1997 Conference on Computer Vision and Pattern Recognition, IEEE Computer Soc. Press, pp. 609–614, 1997

    Google Scholar 

  25. M. Tuceryan, D. S. Greer, R. T. Whitaker, D. Breen, C. Crampton, E. Rose and K. H. Ahlers: “Calibration Requirements and Procedures for Augmented Reality.“ IEEE Transactions on Visualization and Computer Graphics, pp. 255–273, Sept 1995

    Google Scholar 

  26. T. Tuytelaars and L. Van Gool: “Content-based Image Retrieval based on Local Affinely Invariant Regions.“ Third International Conference on Visual Information Systems, Visual99, pp. 493–500, june 1999

    Google Scholar 

  27. M. Uenohara and T. Kanade: Vision-Based Object Registration for Real-Time Image Overlay.” Proceedings CVRMED’95, pp. 14–22, 1995

    Google Scholar 

  28. M. Wloka and B. Anderson: “Resolving Occlusion in Augmented Reality.“ ACM Symposium on Interactive 3D Graphics Proceedings, pp. 5–12, April 1995

    Google Scholar 

References

  1. K. Kutulakos and J. Vallino. Calibration-free augmented reality. IEEE Transactionson Computer Graphics, 4(1):1–20, 1998.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. K. U. Leuven, ESAT-PSI, Kardinaal Mercierlaan 94, B-3000, Leuven, Belgium

    Kurt Cornelis, Marc Pollefeys, Maarten Vergauwen & Luc Van Gool

Authors
  1. Kurt Cornelis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marc Pollefeys
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Maarten Vergauwen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Luc Van Gool
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Center for Processing of Speech and Images, Katholieke Universiteit Leuven, Kasteelpark Arenberg 10, 3001, Leuven-Heverlee, Belgium

    Marc Pollefeys  & Luc Van Gool  & 

  2. Department of Engineering Science, University of Oxford, 19 Parks Road, Oxford OX1, 3PJ, UK

    Andrew Zisserman  & Andrew Fitzgibbon  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Cornelis, K., Pollefeys, M., Vergauwen, M., Van Gool, L. (2001). Augmented Reality Using Uncalibrated Video Sequences. In: Pollefeys, M., Van Gool, L., Zisserman, A., Fitzgibbon, A. (eds) 3D Structure from Images — SMILE 2000. SMILE 2000. Lecture Notes in Computer Science, vol 2018. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45296-6_10

Download citation

  • DOI: https://doi.org/10.1007/3-540-45296-6_10

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-41845-0

  • Online ISBN: 978-3-540-45296-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation