Abstract
Mobile virtual environments, with real-time 3D and 2D graphics, are now possible on smart phone and other camera-enabled devices. Using computer vision, the camera sensor can be treated as an input modality in applications by analyzing the incoming live video. We present our tracking algorithm and several mobile virtual environment and gaming prototypes including: a 3D first person shooter, a 2D puzzle game and a simple action game. Camera-based interaction provides a user experience that is not possible through traditional means, and maximizes the use of the limited display size.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Campbell, D.: Computer Vision in Games. In: Game Developers Conference (2005)
Darken, R.P., Durost, R.: Mixed-dimension interaction in virtual environments. VRST 2005, pp. 38-45 (2005)
Davis, J.W., Bobick, A.: The Representation and Recognition of Action Using Temporal Templates. In: IEEE International Conference on Computer Vision and Pattern Recognition, August 1997, pp. 928–934 (1997)
Hannuksela, J., Sangi, P., Heikkila, J.: A Vision-Based Approach for Controlling User Interfaces of Mobile Devices. In: IEEE Workshop on Vision for Human-Computer Interaction (V4HCI) (to appear, 2005)
Haro, A., Mori, K., Capin, T., Wilkinson, S.: Mobile Camera-Based User Interaction. In: Proceedings of ICCV-HCI, pp. 79–89 (2005)
Moehring, M., Lessig, C., Bimber, O., Video See-Through, A.R.: on Consumer Cell Phones. In: Proceedings of ISMAR 2004 (2004)
Rohs, M.: Real-world Interaction with Camera-phones. In: Murakami, H., Nakashima, H., Tokuda, H., Yasumura, M. (eds.) UCS 2004. LNCS, vol. 3598, Springer, Heidelberg (2005)
Siio, I.: Scroll Display: Pointing Device for Palm-top Computers. In: Asia Pacific Computer Human Interaction 1998 (APCHI 1998), Japan, July 15-17, 1998, pp. 243–248 (1998)
Yee, K.-P.: Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. In: Proceedings of CHI 2003 Human Factors in Computing Systems, pp. 1–8 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Çapın, T., Haro, A., Setlur, V., Wilkinson, S. (2006). Camera-Based Virtual Environment Interaction on Mobile Devices. In: Levi, A., Savaş, E., Yenigün, H., Balcısoy, S., Saygın, Y. (eds) Computer and Information Sciences – ISCIS 2006. ISCIS 2006. Lecture Notes in Computer Science, vol 4263. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11902140_80
Download citation
DOI: https://doi.org/10.1007/11902140_80
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-47242-1
Online ISBN: 978-3-540-47243-8
eBook Packages: Computer ScienceComputer Science (R0)