Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
SpringerLink
Log in

Robust camera pose tracking for augmented reality using particle filtering framework

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

In this paper, we present new solutions for the problem of estimating the camera pose using particle filtering framework. The proposed approach is suitable for real-time augmented reality (AR) applications in which the camera is held by the user. This work demonstrates that particle filtering improve the robustness of the tracking comparing to existing approaches, such as those based on the Kalman filter. We propose a tracking framework for both points and lines features, the particle filter is used to compute the posterior density for the camera 3D motion parameters. We also analyze the sensitivity of our technique when outliers are present in the match data. Outliers arise frequently due to incorrect correspondences which occur because of either image noise or occlusion. Results from real data in an augmented reality setup are then presented, demonstrating the efficiency and robustness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Lowe D.G. (1991). Fitting parameterized three-dimensional models to images. IEEE Trans. Pattern Anal. Machine Intell. 13: 441–450

    Article  Google Scholar 

  2. Haralick R.M. (1989). Pose estimation from corresponding point data. IEEE Trans. Syst. Man Cybernet. 19(6): 1426–1446

    Article  Google Scholar 

  3. Kumar R. and Hanson A.R. (1994). Robust methods for estimating pose and a sensitivity analysis. Comput. Vis. Image Underst. 60(11): 313–342

    Article  Google Scholar 

  4. Horn B.K.P., Hilden H.M. and Negahdaripour S. (1988). Closed-form solution of absolute orientation using orthonomal matrices. J. Opt. Soc. Am. 5(7): 1127–1135

    Article  MathSciNet  Google Scholar 

  5. De Menthon D.F. and Davis L.S. (1995). Model-based object pose in 25 lines of code. Int. J. Comput. Vis. 15(1–2): 123–141

    Article  Google Scholar 

  6. Haralick R.M., Joo H., Lee C., Zhuang X., Vaidya V. and Kim M. (1989). Pose estimation from corresponding point data. IEEE Trans. Syst. Man Cybernet. 19(6): 1426–1446

    Article  Google Scholar 

  7. Lu C.P., Hager G. and Mjolsness E. (2000). Fast and globally convergent pose estimation from video images. IEEE Trans. Pattern Anal. Mach. Intell. 22(6): 610–622

    Article  Google Scholar 

  8. Jiang, B., Neumann, N.: Extendible tracking by line auto-calibration. In: Proceedings of IEEE and ACM International Symposium on Augmented Reality (ISMAR’01), pp. 97–103 (2001)

  9. Yoon, Y., Kosaka, A., Park, J.B., Kak, A.C.: A new approach to the use of edge extremities for model-based object tracking. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation (ICRA 2005). pp. 1883–1889, Barcelona (2005)

  10. Kyrki, V., Kragic, D.: Integration of model-based and model-free cues for visual object tracking in 3D. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation (ICRA 2005), pp. 1554–1560, Barcelona (2005)

  11. Kragic, D., Kyrki, V.: Initialization and system modeling in 3-D pose tracking. In: Proceedings of the International Conference on Pattern Recognition (ICPR’06), pp. 643–646, Hong Kong (2006)

  12. Taylor, G., Kleeman, L.: Fusion of multimodal visual cues for model-based object tracking. In: Proceedings of the 2003 Australasian Conference on Robotics and Automation (ACRA’03), pp. 1–8, Brisbane, Australia (2003)

  13. Lepetit V. and Fua P. (2005). Monocular model-based 3D tracking of rigid objects: a survey. Comput. Graph. Vis. 1(1): 1–89

    Article  Google Scholar 

  14. Ababsa, F., Mallem, M., Roussel, D.: Comparison between particle filter approach and Kalman filter-based technique for head tracking in augmented reality systems. In: Proceedings of the 2004 IEEE International Conference on Robotics and Automation (ICRA2004), pp. 1021–1026 (2004)

  15. Bergman, N., Doucet, A.: Markov Chain Monte Carlo data association for target tracking. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (2000)

  16. Doucet A., Gordon N.J. and Krishnamurthy V. (2001). Particle filters for state estimation of jump Markov linear systems. IEEE Trans. Signal Process. 49(3): 613–624

    Article  Google Scholar 

  17. Gordon N.J. (1997). A hybrid bootstrap filter for target tracking in clutter. IEEE Trans. Aerosp. Electron. Syst. 33: 353–358

    Article  Google Scholar 

  18. Pupilli, M., Calway, A.: Real-time camera tracking using a particle filter. In: Proceedings of the British Machine Vision Conference, BMVA Press, pp. 519–528 (2005)

  19. Thrun S., Fox D., Dellaert F. and Burgard W. (2001). Particle filters for mobile robot localization. In: Doucet, A. and Gordon, N. (eds) Sequential Monte Carlo Methods in Practice, pp. Springer, Heidelberg

    Google Scholar 

  20. Qian G., Chellappa R. and Zheng Q. (2005). Bayesian algorithms for simultaneous structure from motion estimation of multiple independently moving objects. IEEE Trans. Signal Process. 14(1): 94–109

    MathSciNet  Google Scholar 

  21. Qian, G., Chellappa, R.: Moving targets detection using sequential importance sampling. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City (2001)

  22. Qian, G., Chellappa, R.: Structure from motion using sequential monte carlo methods. In: Proceedings of International Conference on Computer Vision, pp. 614–621 (2001)

  23. Marimon, D., Maret, Y., Abdeljaoued, Y., Ebrahimi, T.: Particle filter-based camera tracker fusing marker- and feature point-based cues. In: Proceedings of the IS&T/SPIE Electronic Imaging Conference on Visual Communications and Image Processing (2007)

  24. Marimon, D., Ebrahimi, T.: Combination of video-based camera trackers using a dynamically adapted particle filter. In: Proceedings of 2nd International Conference on Computer Vision Theory and Applications (VISAPP’07), pp. 363–370, Barcelona (2007)

  25. Klein, G., Murray, D.: Full-3D edge tracking with a particle filter. In: Proceedings of the British Machine Vision Conference (BMVC’06). Edinburgh (2006)

  26. Ababsa, F., Mallem, M.: Robust line tracking using a particle filter for camera pose estimation. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST 2006), pp. 207–211 Limassol (Cyprus) (2006)

  27. Isard M. and Blake A. (1998). Condensation—conditional density propagation for visual tracking. Int. J. Comput. Vis. 29(1): 5–28

    Article  Google Scholar 

  28. Gordon N.J., Salmond D.J. and Smith A.F.M. (1993). A novel approach to nonlinear/non Gaussian Bayesian state estimation. IEEE Proc. Radar Signal Process. 140(2): 107–113

    Article  Google Scholar 

  29. Azuma R., Baillot Y., Behringer R., Feiner S., Julier S. and MacIntyre B. (2001). Recent advances in augmented reality. IEEE Comput. Graph. Appl. 25(6): 24–35

    Google Scholar 

  30. Cho, Y., Neumann, U.: Multi-ring color fiducial systems for scalable fiducial tracking augmented reality. In: Proceedings of the Virtual Reality Annual International Symposium (VRAIS’98), pp. 212, Washington, DC (1998)

  31. Naimark, L., Foxlin, E.: Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker. In: proceedings of ACM/IEEE Int. Symp. on Mixed and Augmented Reality (ISMAR 2002), pp. 27–36, Darmstadt (2002)

  32. Rekimoto, J.: Matrix: A realtime object identification and registration method for augmented reality. In: Proceedings of the 3rd Asian Pacific Computer and Human Interaction (APCHI’98), pp. 63–68, Washington DC (1998)

  33. Rekimoto, J., Ayatsuka, Y.: Cybercode: designing augmented reality environments with visual tags. In: Proceedings of DARE 2000 on Designing augmented reality environments, pp. 1–10, Elsinore (2000)

  34. Kato, H., Billinghurst, M., Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd ACM/IEEE Int. Workshop on Augmented Reality (IWAR’99), pp. 85–92, Washington DC (1999)

  35. Zhang, X., Fronz, S., Navab, N.: Visual marker detection and decoding in AR systems: a comparative study. In: Proceedings of the ACM/IEEE Int. Symp. on Mixed and Augmented Reality (ISMAR’02), pp 97, Washington, DC (2002)

  36. Owen, C.B., Fan, X., Middlin, P.: What is the best fiducial? In augmented reality toolkit, In: The 1st IEEE International Workshop. IEEE (2002)

  37. Fiala, M.: Artag, a fiducial marker system using digital techniques. In: Proceedings of the 2005 IEEE International Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 2, pp. 590–596, Washington, DC (2005)

  38. Wuest, H., Vial, F., Stricker, D.: Adaptive line tracking with multiple hypotheses for augmented reality. In: Proceedings of ACM/IEEE Int. Symp. on Mixed and Augmented Reality (ISMAR 2005), pp. 62–69, Vienna (2005)

  39. Drummond T. and Cipolla R. (2002). Real-time visual tracking of complex structures. IEEE Trans. Pattern Anal. Mach. Intell. 24(7): 932–946

    Article  Google Scholar 

  40. Comport A.I., Marchand E., Pressigout M. and Chaumette F. (2006). Real-time markerless tracking for augmented reality: the virtual visual servoing framework. IEEE Trans. Vis. Comput. Graph. 12(6): 615–628

    Article  Google Scholar 

  41. Lepetit, V., Vacchetti, L., Thalmann, D., Fua, P.: Fully automated and stable registration for augmented reality applications. In: Proceedings of ACM/IEEE Int. Symp. on Mixed and Augmented Reality (ISMAR 2003), p 93. Tokyo (2003)

  42. Vacchetti, L., Lepetit, V., Fua, P.: Combining edge and texture information for real-time accurate 3D camera tracking. In: Proceedings of ACM/IEEE Int. Symp. on Mixed and Augmented Reality (ISMAR 2004), pp. 48–57, Arlington (2004)

  43. Pressigout, M., Marchand, E.: Real-time 3D model-based tracking: combining edge and texture information. In: Proceedings of the 2006 IEEE Int. Conf on Robotics and Automation (ICRA 06), pp. 2726–2731, Orlando (2006)

  44. Doucet, A., de Freitas, N., Gordon, N. (eds.).: Sequential Monte Carlo Methods in Practice. Springer, Heidelberg (2001)

    MATH  Google Scholar 

  45. Beutelspacher, A., Rosenbaum, U.: Projective Geometry. Cambridge University Press, London

  46. Lichtenauer, J., Reinders M., Hendriks, E.: Of the observation likelihood function on particle filtering performance in tracking applications. In: Proceedings of the 2004 IEEE International Conference on Automatic Face and Gesture Recognition, pp. 767–772, Delft (2004)

  47. Ronnie, L., Johansson, M., Suzic, R.: Particle filter-based information acquisition for robust plan recognition. In: Proceedings of the 2005 International Conference on Information Fusion, pp. 8, Stockholm (2005)

  48. Czyz, J.: Object detection in video via particle filters. In: Proceedings of the International Conference on Pattern Recognition (ICPR’06), pp. 820–823, Hong Kong (2006)

  49. Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference, pp. 147–151 (1988)

Download references

Author information

Authors and Affiliations

  1. Laboratoire IBISC, CNRS FRE 2873, University d’Evry Val d’Essonne, 40 rue du Pelvoux, 91020, Evry, France

    Fakhreddine Ababsa & Malik Mallem

Authors
  1. Fakhreddine Ababsa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Malik Mallem
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fakhreddine Ababsa.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ababsa, F., Mallem, M. Robust camera pose tracking for augmented reality using particle filtering framework. Machine Vision and Applications 22, 181–195 (2011). https://doi.org/10.1007/s00138-007-0100-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-007-0100-4

Keywords

Search

Navigation