Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Multiple Camera, Multiple Person Tracking with Pointing Gesture Recognition in Immersive Environments

  • Conference paper
Advances in Visual Computing (ISVC 2008)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 5358))

Included in the following conference series:

Abstract

In this paper, we present a technique that allows multiple participants within a large-scale immersive, virtual environment to interact with it using pointing gestures. Multiple cameras observing the environment are used along with various computer vision techniques to obtain a 3-D reconstruction of each participant’s finger position, allowing the participants to point at and interact with virtual objects. This use of the pointing gesture provides an intuitive method of interaction, and has many applications in the field of human computer interaction. No markers or special clothing are required to be worn. Furthermore, we show that the system is able to provide robust results in real time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Cruz-Neira, C., Sandin, D., DeFanti, T.: Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In: Proceedings of the 20th annual conference on Computer graphics and interactive techniques, pp. 135–142 (1993)

    Google Scholar 

  2. McGinity, M., Shaw, J., Kuchelmeister, V., Hardjono, A., Del Favero, D.: AVIE: a versatile multi-user stereo 360 interactive VR theatre. In: Proceedings of the 2007 workshop on Emerging displays technologies: images and beyond: the future of displays and interacton (2007)

    Google Scholar 

  3. Han, J.: Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection

    Google Scholar 

  4. Bradski, G.: OpenCV: Examples of use and new applications in stereo, recognition and tracking. In: Proc. Intern. Conf. on Vision Interface (VI 2002) (2002)

    Google Scholar 

  5. Vladimir, I., Rajeev, T.: Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review (1997)

    Google Scholar 

  6. Kahn, R., Swain, M.: Understanding people pointing: The Perseus system. In: Proceedings of the International Symposium on Computer Vision (November 1995)

    Google Scholar 

  7. Nickel, K., Stiefelhagen, R.: Real-time Recognition of 3D-Pointing Gestures for Human-Machine-Interaction. In: Michaelis, B., Krell, G. (eds.) DAGM 2003. LNCS, vol. 2781, pp. 557–565. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  8. Moeslund, T., Storring, M., Granum, E.: A Natural Interface to a Virtual Environment through Computer Vision-Estimated Pointing Gestures. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS, vol. 2298. Springer, Heidelberg (2002)

    MATH  Google Scholar 

  9. Yuan, C.: Visual Tracking for Seamless 3D Interactions in Augmented Reality. In: Bebis, G., Boyle, R., Koracin, D., Parvin, B. (eds.) ISVC 2005. LNCS, vol. 3804, pp. 321–328. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  10. Malerczyk, C.: Interactive Museum Exhibit Using Pointing Gesture Recognition. In: Proceedings of the 12-th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, pp. 165–171 (2004)

    Google Scholar 

  11. Kehl, R., Van Gool, L.: Real-time pointing gesture recognition for an immersive environment. In: Proceedings. Sixth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 577–582 (2004)

    Google Scholar 

  12. Tsai, R.: An efficient and accurate camera calibration technique for 3D machine vision. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 374 (1986)

    Google Scholar 

  13. Gabriel, P., Verly, J., Piater, J., Genon, A.: The state of the art in multiple object tracking under occlusion in video sequences. Advanced Concepts for Intelligent Vision Systems, 166–173 (2003)

    Google Scholar 

  14. Welch, G., Bishop, G.: An Introduction to the Kalman Filter. In: ACM SIGGRAPH 2001 Course Notes (2001)

    Google Scholar 

  15. Chen, H., Lin, H., Liu, T.: Multi-object tracking using dynamical graph matching. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 2 (2001)

    Google Scholar 

  16. Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proc. DARPA Image Understanding Workshop, pp. 121–130 (1981)

    Google Scholar 

  17. Chanda, B., Majumder, D.: Digital Image Processing and Analysis. Prentice Hall of India, Englewood Cliffs (2003)

    Google Scholar 

  18. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, University of New South Wales, Sydney, NSW 2052, Australia

    Anuraag Sridhar & Arcot Sowmya

Authors
  1. Anuraag Sridhar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arcot Sowmya
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada, Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. Digital Image Research Center, Kingston University, London, UK

    Paolo Remagnino

  6. Mitsubishi Electric Research Laboratories, P.O. Box 02139, Cambridge, MA, USA

    Fatih Porikli

  7. Computer and Information Science and Engineering, University of Florida, P.O. Box, FL 32611-6120, Gainsville, USA

    Jörg Peters

  8. IBM T.J. Watson Research Center, 19 Skyline Drive, NY 10532, Hawthorne, USA

    James Klosowski

  9. 128 Memorial Mall, Stewart B001, IN 47907, West Lafayette, USA

    Laura Arns

  10. Denver Museum of Nature and Space, 2001 Colorade Blvd. Denver,, CO 80205, USA

    Yu Ka Chun

  11. Departmen of Computer Science,, NC State University, Campus Box 8206, NC 27695-8206, Raleigh, USA

    Theresa-Marie Rhyne

  12. Los Alamos National Labs, P.O. Box 1663, NM 87545, Los Alamos, USA

    Laura Monroe

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sridhar, A., Sowmya, A. (2008). Multiple Camera, Multiple Person Tracking with Pointing Gesture Recognition in Immersive Environments. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2008. Lecture Notes in Computer Science, vol 5358. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89639-5_49

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89639-5_49

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89638-8

  • Online ISBN: 978-3-540-89639-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation