research-article

Touch & interact: touch-based interaction of mobile phones with displays

Authors:

Enrico RukzioAuthors Info & Claims

MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

Pages 245 - 254

https://doi.org/10.1145/1409240.1409267

Published: 02 September 2008 Publication History

Abstract

The limited screen size and resolution of current mobile devices can still be problematic for map, multimedia and browsing applications. In this paper we present Touch & Interact: an interaction technique in which a mobile phone is able to touch a display, at any position, to perform selections. Through the combination of the output capabilities of the mobile phone and display, applications can share the entire display space. Moreover, there is potential to realize new interaction techniques between the phone and display. For example, select & pick and select & drop are interactions whereby entities can be picked up onto the phone or dropped onto the display. We report the implementation of Touch & Interact, its usage for a tourist guide application and experimental comparison. The latter shows that the performance of Touch & Interact is comparable to approaches based on a touch screen; it also shows the advantages of our system regarding ease of use, intuitiveness and enjoyment.

References

[1]

Forman, G. H. and Zahorjan, J. The Challenges of Mobile Computing. IEEE Computer. 27 (4). 1994.

Digital Library

[2]

Ferscha, A., Kathan, G. Vogl, S. WebWall - An Architecture for Public Display WWW Services. World Wide Web Conference, Honolulu, Hawaii, 2002.

[3]

Cheverst, K., Dix A., Fitton, D, Kray, C., Rouncefield, M., Sas, C., Saslis-Lagoudakis, G., Sheridan, J. G.: Exploring Bluetooth based mobile phone interaction with the hermes photo display. MobileHCI 2005, Salzburg, Austria, 2005.

Digital Library

[4]

SpotCode Interfaces, http://www.cl.cam.ac.uk/Research/SRG/netos/uid/spotcode.html

[5]

Ballagas, R., Rohs, M., Sheridan, J., Borchers, J. Sweep and Point & Shoot: Phonecam-Based Interactions for Large Public Displays. CHI 2005, New York, NY, USA, 2005.

Digital Library

[6]

Ballagas, R., Rohs, M., Sheridan, J., Borchers, J. The Smart Phone: A Ubiquitous Input Device. In: IEEE Pervasive Computing, 5 (1), 2006.

Digital Library

[7]

Sharp, R., Scott, J., Beresford, A. R. Secure Mobile Computing Via Public Terminals. In Proc. Pervasive'06. Springer. 238--253. 2006

Digital Library

[8]

M. C. Maguire. A review of user-interface design guidelines for public information kiosk systems. Academic Press, Inc. Duluth, MN, USA. March 1999

Digital Library

[9]

Vogel, D. and Baudisch, P. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proceedings of CHI 2007, San Jose, CA, Apr 28-May 18, 2007, pp. 657--666.

Digital Library

[10]

Fitzmaurice, G. W. Situated information spaces and spatially aware palmtop computers. In: Communications of the ACM, 36 (7), pages 39--49, ISSN 0001-0782, 1993.

[11]

Brad A. Myers; Herb Stiel; Robert Gargiulo: Collaboration using multiple PDAs connected to a PC. Proceedings of the 1998 ACM conference on Computer supported cooperative work, ACM Press, ISBN 1-58113-009-0, Seattle, Washington, United States, 1998.

Digital Library

[12]

Roy Want; Kenneth P. Fishkin; Anuj Gujar; Beverly L. Harrison: Bridging physical and virtual worlds with electronic tags. Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, ACM Press, ISBN 0-201-48559-1, Pittsburgh, Pennsylvania, United States, 1999.

Digital Library

[13]

John Boyd: Here Comes The Wallet Phone. In: IEEE Spektrum, 42 (11), pages 12--13, 2005.

[14]

Reilly, D., Rodgers, M., Argue, R., Nunes, M., Inkpen, K.: Marked-up maps: combining paper maps and electronic information resources. In: Personal Ubiquitous Comput., 10 (4), pages 215--226, ISSN 1617--4909, 2006.

Digital Library

[15]

Madhavapeddy, A., Scott, D., Sharp, R., Upton, E. Using Camera-Phones to Enhance Human Computer Interaction. Adjunct Proceedings of Ubicomp 2004, Nottingham, UK, 2004

[16]

Miyaoku, K., Higashino, S., Tonomura, Y.: C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal. UISY 2004, ACM Press, Santa Fe, NM, USA, 2004.

Digital Library

[17]

Forlines, C., Balakrishnan, R., Beardsley, P., van Baar, J., Raskar, R. Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors. UIST '05, Seattle, USA, 2005.

Digital Library

[18]

Silfverberg, M., MacKenzie, S., Kauppinen, T.: An Isometric Joystick as a Pointing Device for Handheld Information Terminals. Graphics Interface, Canadian Information Processing Society, Ottawa, Ontario, Canada, 2001.

Digital Library

[19]

Jun Rekimoto. Pick-and-drop: a direct manipulation technique for multiple computer environments. UIST'97. Banff, Alberta, Canada, 1997.

Digital Library

[20]

Paul Dietz; Darren Leigh. DiamondTouch: a multi-user touch technology. UIST '01. Orlando, Florida, 2001.

Digital Library

[21]

Microsoft Surface, http://www.microsoft.com/surface/

[22]

Vetter, J., Hamard. J., Paolucci, M., Rukzio, E. Schmidt, A. Physical Mobile Interaction with Dynamic Physical Objects. In Proceedings of MobileHCI 2007, Singapore, 2007.

Digital Library

[23]

Hitachi Global News Release, http://www.hitachi.com/New/cnews/030902.html

[24]

Nokia Wireless Presenter, http://europe.nokia.com/A4149109

[25]

Douglas, S. A., Kirkpatrick, A. E., and MacKenzie, I. S. 1999. Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard. SIGCHI Conference on Human Factors in Computing Systems, Pittsburgh, Pennsylvania, USA, May 15--20, 1999. CHI '99.

Digital Library

[26]

Venkatesh, V., Morris, M. G., Davies, G. B., Davies, D. D., User Acceptance of Information Technology: Toward a unified view. MIS Quarterly Vol. 27 No. 3, pp. 425--478/September 2003.

Digital Library

[27]

Mulitag project, http://eis.comp.lancs.ac.uk/multitag/

Cited By

Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Huang ZLi YKong J(2022)Investigating the multimedia pointing techniques in the tabletop-centric cross-device interactionMultimedia Tools and Applications10.1007/s11042-022-12975-082:7(10077-10098)Online publication date: 21-Apr-2022
https://doi.org/10.1007/s11042-022-12975-0
Show More Cited By

Index Terms

Touch & interact: touch-based interaction of mobile phones with displays
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping

Recommendations

Exploring finger specific touch screen interaction for mobile phone user interfaces
OzCHI '14: Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design

Today, mobile phones with touch screens are widespread but as de facto, the interaction space is limited to single finger taps or multitouch gestures. In this paper, we present an investigation of a novel interaction concept for mobile phone touch ...
Touch & Interact: touch-based interaction with a tourist application
MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

Touch & Interact is an interaction technique which combines mobile phones and public displays. The motivation for the project is to overcome the intrinsic output limitations of mobile phones. Touch & Interact extends the phone output to a public display ...
Mobile interaction with static and dynamic NFC-based displays
MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services

This paper reports on a development framework, two prototypes, and a comparative study in the area of multi-tag Near-Field Communication (NFC) interaction. By combining NFC with static and dynamic displays, such as posters and projections, services are ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

September 2008

568 pages

ISBN:9781595939524

DOI:10.1145/1409240

Conference Chairs:
Henri ter Hofte
Telematica Instituut
,
Ingrid Mulder
Telematica Instituut & Rotterdam University

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 September 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI08

MobileHCI08: 10th International Conference on Human Computer Interaction with Mobile Devices and Services

September 2 - 5, 2008

Amsterdam, The Netherlands

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

87
Total Citations
View Citations
3,328
Total Downloads

Downloads (Last 12 months)69
Downloads (Last 6 weeks)21

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Huang ZLi YKong J(2022)Investigating the multimedia pointing techniques in the tabletop-centric cross-device interactionMultimedia Tools and Applications10.1007/s11042-022-12975-082:7(10077-10098)Online publication date: 21-Apr-2022
https://doi.org/10.1007/s11042-022-12975-0
Not ECavada DVenturini A(2022)Internet of Things and Ubiquitous Computing in the Tourism DomainHandbook of e-Tourism10.1007/978-3-030-48652-5_18(295-315)Online publication date: 2-Sep-2022
https://doi.org/10.1007/978-3-030-48652-5_18
Yeon Y(2021)KMapper: A Field Geological Survey SystemISPRS International Journal of Geo-Information10.3390/ijgi1006040510:6(405)Online publication date: 12-Jun-2021
https://doi.org/10.3390/ijgi10060405
Le KTran TChlasta KKrejtz KFjeld MKunz A(2021)VXSlate: Exploring Combination of Head Movements and Mobile Touch for Large Virtual Display InteractionProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462076(283-297)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462076
Maity SYang DRedford SDas DChatterjee BSen S(2020)BodyWire-HCIACM Transactions on Computer-Human Interaction10.1145/340623827:6(1-25)Online publication date: 8-Nov-2020
https://dl.acm.org/doi/10.1145/3406238
Dong ZPiumsomboon TZhang JClark ABai HLindeman RBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)A Comparison of Surface and Motion User-Defined Gestures for Mobile Augmented RealityExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3382883(1-8)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3382883
Not ECavada DVenturini A(2020)Internet of Things and Ubiquitous Computing in the Tourism DomainHandbook of e-Tourism10.1007/978-3-030-05324-6_18-1(1-22)Online publication date: 17-Mar-2020
https://doi.org/10.1007/978-3-030-05324-6_18-1
Li ZAnnett MHinckley KWigdor D(2019)SMACProceedings of the ACM on Human-Computer Interaction10.1145/33009613:EICS(1-47)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3300961
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents