Abstract
Augmented Reality (AR) research has been conducted for several decades, although until recently most AR applications had simple interaction methods using traditional input devices. AR tracking, display technology and software has progressed to the point where commercial applications can be developed. However there are opportunities to provide new advanced interaction techniques for AR applications. In this paper we describe several interaction methods that can be used to provide a better user experience, including tangible user interaction, multimodal input and mobile interaction.
Chapter PDF
Similar content being viewed by others
References
Azuma, R.: A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6(4), 355–385 (1997)
Sutherland, I.: The Ultimate Display. International Federation of Information Processing 2, 506–508 (1965)
Ishii, H., Ullmer, B.: Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In: Proceedings of CHI 1997, Atlanta, Georgia, USA, pp. 234–241. ACM Press, New York (1997)
Rekimoto, J.: The World Through the Computer: A New Human-Computer Interaction Style Based on Wearable Computers. Technical Report SCSL-TR-94-013, Sony Computer Science Laboratories Inc. (1994)
Feiner, S., MacIntyre, B., Hollerer, T., Webster, A.: A Touring Machine: Prototyping 3D Mobile Augmented Reality Systems for Exploring the Urban Environment. In: Proceedings of the 1st IEEE international Symposium on Wearable Computers, ISWC, October 13-14, 1997, IEEE Computer Society, Washington (1997)
Butterworth, J., Davidson, A., Hench, S., Olano, M.T.: 3DM: a three dimensional modeler using a head-mounted display. In: Proceedings of the 1992 Symposium on interactive 3D Graphics, SI3D 1992, Cambridge, Massachusetts, United States, pp. 135–138. ACM, New York (1992)
Poupyrev, I., Billinghurst, M., Weghorst, S., Ichikawa, T.: The Go-Go Interaction Technique. In: Proc. Of UIST 1996, pp. 79–80. ACM Press, New York (1996)
Stoakley, R., Conway, M., Pausch, R.: Virtual Reality on a WIM: Interactive Worlds in Miniature. In: Proceedings of CHI 1995, ACM Press, New York (1995)
Gabbard, J.L.: A taxonomy of usability characteristics in virtual environments. M.S. Thesis, Virginia Polytechnic Institute and State University (1997), http://www.vpst.org/jgabbard/ve/framework/
Bajura, M., Fuchs, H., et al.: Merging Virtual Objects with the Real World: Seeing Ultrasound Imagery Within the Patient. In: SIGGRAPH 1992, ACM, New York (1992)
Feiner, S., MacIntyre, B., et al.: Knowledge-Based Augmented Reality. Communications of the ACM 36(7), 53–62 (1993)
Kiyokawa, K., Takemura, H., Yokoya, N.: A Collaboration Supporting Technique by Integrating a Shared Virtual Reality and a Shared Augmented Reality. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (SMC 1999), Tokyo, vol. VI, pp. 48–53 (1999)
Schmalstieg, D., Fuhrmann, A., et al.: Bridging multiple user interface dimensions with augmented reality systems. In: ISAR 2000, IEEE, Los Alamitos (2000)
Butz, A., Hollerer, T., et al.: Enveloping Users and Computers in a Collaborative 3D Augmented Reality. In: Proceedings of IWAR 1999, San Francisco, October 20-21, pp. 35–44 (1999)
Rekimoto, J., Ayatsuka, Y., et al.: Augment-able reality: Situated communication through physical and digital spaces. In: ISWC 1998, IEEE, Los Alamitos (1998)
Hollerer, T., Feiner, S., et al.: Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system. IEEE Computers & Graphics 23, 779–785 (1999)
Anabuki, M., Kakuta, H., et al.: Welbo: An Embodied Conversational Agent Living in Mixed Reality Spaces. In: CHI 2000, Extended Abstracts, ACM, New York (2000)
Weiser, M.: The Computer for the Twenty-First Century. Scientific American 265(3), 94–104 (1991)
Gorbet, M., Orth, M., Ishii, H.: Triangles: Tangible Interface for Manipulation and Exploration of Digital Information Topography. In: Proceedings of CHI 1998, Los Angeles (1998)
Underkoffler, J., Ishii, H.: Urp: a luminous-tangible workbench for urban planning and design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: the CHI Is the Limit, CHI 1999, Pittsburgh, Pennsylvania, United States, May 15-20, 1999, pp. 386–393. ACM, New York (1999)
Bolt, R.A.: Put-That-There: Voice and Gesture at the Graphics Interface. In: Proceedings of ACM SIGGRAPH 1980, Computer Graphics, vol. 14, pp. 262–270 (1980)
Weimer, D., Ganapathy, S.K.: A Synthetic Visual Environment with Hand Gesturing and Voice Input. In: Proceedings of ACM Conference on Human Factors in Computing Systems, pp. 235–240 (1989)
Laviola Jr., J.J.: Whole-Hand and Speech Input in Virtual Environments. Master Thesis, Brown University (1996)
Olwal, A., Benko, H., Feiner, S.: SenseShapes: Using Statistical Geometry for Object Selection in a Multimodal Augmented Reality System. In: Proceedings of The Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2003), October 2003, pp. 300–301 (2003)
Kaiser, E., Olwal, A., McGee, D., Benko, H., Corradini, A., Xiaoguang, L., Cohen, P., Feiner, S.: Mutual Dissambiguation of 3D Multimodal Interaction in Augmented and Virtual Reality. In: Proceedings of The Fifth International Conference on Multimodal Interfaces (ICMI 2003), pp. 12–19 (2003)
Träskbäck, M., Haller, M.: Mixed reality training application for an oil refinery: user requirements. In: ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry, VRCAI 2004, Singapore, pp. 324–327 (2004)
Wagner, D., Schmalstieg, D.: First steps towards handheld augmented reality. In: Proc. of the 7th International Symposium on Wearable Computers (ISWC 2003), White Plains, pp. 127–137. IEEE Computer Society, Los Alamitos (2003)
Moehring, M., Lessig, C., Bimber, O.: AR Video See-Through on Consumer Cell Phones. In: Proc. of International Symposium on Augmented and Mixed Reality (ISMAR 2004), pp. 252–253 (2004)
Henrysson, A., Ollila, M.: UMAR - Ubiquitous Mobile Augmented Reality. In: Proc. Third International Conference on Mobile and Ubiquitous Multimedia (MUM 2004), College Park, Maryland, USA, October 27-29, 2004, pp. 41–45 (2004)
MosquitoHunt, http://w4.siemens.de/en2/html/press/newsdesk_archive/2003/foe03111.html
Mogilev, D., Kiyokawa, K., Billinghurst, M., Pair, J.: AR Pad: An Interface for Face-to-face AR Collaboration. In: Proc. of the ACM Conference on Human Factors in Computing Systems 2002 (CHI 2002), Minneapolis, pp. 654–655 (2002)
Kato, H., Billinghurst, M., Poupyrev, I., Tetsutani, N., Tachibana, K.: Tangible Augmented Reality for Human Computer Interaction. In: Proc. of Nicograph 2001, Tokyo, Japan (2001)
Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K., Tachibana, K.: Virtual Object Manipulation on a Table-Top AR Environment. In: Proceedings of the International Symposium on Augmented Reality (ISAR 2000), October 2000, pp. 111–119 (2000)
ARToolKit, http://www.hitl.washington.edu/artoolkit
Denecke, M.: Rapid Prototyping for Spoken Dialogue Systems. In: Proceedings of the 19th international conference on Computational Linguistics, vol. 1, pp. 1–7 (2002)
Irawati, S., Green, S., Billinghurst, M., Duenser, A., Ko, H.: An evaluation of an augmented reality multimodal interface using speech and paddle gestures. In: Pan, Z., Cheok, D.A.D., Haller, M., Lau, R., Saito, H., Liang, R. (eds.) ICAT 2006. LNCS, vol. 4282, pp. 272–283. Springer, Heidelberg (2006)
Hinckley, K., Pausch, R., Proffitt, D., Patten, J., Kassell, N.: Cooperative Bimanual Action. In: ACM CHI 1997 Conference on Human Factors in Computing Systems, pp. 27–34 (1997)
Henrysson, A., Billinghurst, M., Ollila, M.: Virtual object manipulation using a mobile phone. In: Proceedings of the 2005 international conference on Augmented tele-existence, Christchurch, New Zealand, December 5-8 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Billinghurst, M., Kato, H., Myojin, S. (2009). Advanced Interaction Techniques for Augmented Reality Applications. In: Shumaker, R. (eds) Virtual and Mixed Reality. VMR 2009. Lecture Notes in Computer Science, vol 5622. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02771-0_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-02771-0_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02770-3
Online ISBN: 978-3-642-02771-0
eBook Packages: Computer ScienceComputer Science (R0)