research-article

User learning and performance with bezel menus

Authors:

Ravin BalakrishnanAuthors Info & Claims

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2221 - 2230

https://doi.org/10.1145/2207676.2208376

Published: 05 May 2012 Publication History

Abstract

Touchscreen phones tend to require constant visual attention, thus not allowing eyes-free interaction. For users with visual impairment, or when occupied with another task that requires a user's visual attention, these phones can be difficult to use. Recently, marks initiating from the bezel, the physical touch-insensitive frame surrounding a touchscreen display, have been proposed as a method for eyes-free interaction. Due to the physical form factor of the mobile device, it is possible to access different parts of the bezel eyes-free. In this paper, we first studied the performance of different bezel menu layouts. Based on the results, we designed a bezel-based text entry application to gain insights into how bezel menus perform in a real-world application. From a longitudinal study, we found that the participants achieved 9.2 words per minute in situations requiring minimal visual attention to the screen. After only one hour of practice, the participants transitioned from novice to expert users. This shows that bezel menus can be adopted for realistic applications.

References

[1]

Accot, J. and Zhai, S. More Than Dotting the i's - Foundations for Crossing-based Interfaces. CHI 2002, ACM, 73--80.

Digital Library

[2]

Andersen, T. H. and Zhai, S. "Writing with Music": Exploring the Use of Auditory Feedback in Gesture Interfaces. ACM Transactions on Applied Perception 7, 3 (2010), 1--24.

Digital Library

[3]

Apple - Accessibility - iPhone - VoiceOver. http://www.apple.com/accessibility/iphone/vision.html

[4]

PlayBook. http://us.blackberry.com/playbook-tablet/

[5]

Bonner, M. N. et al. No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry. Pervasive 2010, 409--426.

Digital Library

[6]

Bragdon, A. et al. Experimental Analysis of Touch-Screen Gesture Designs in Mobile Environments. CHI 2011, ACM, 403--412.

Digital Library

[7]

Callahan, J. et al. An Empirical Comparison of Pie vs. Linear Menus. CHI 1988, ACM, 95--100.

Digital Library

[8]

Castellucci, S. J. and MacKenzie, I. S. Graffiti vs. Unistrokes: An Empirical Comparison. CHI 2008, ACM, 305--308.

Digital Library

[9]

Clarkson, E., Clawson, J., Lyons, K. and Starner, T. An Empirical Study of Typing Rates on mini-QWERTY Keyboards. Ext. Abstracts CHI 2005, ACM, 1288--91.

Digital Library

[10]

Concise Oxford Dictionary Letter Frequency: http://www.oxforddictionaries.com/page/133

[11]

Froehlich, J., Wobbrock, J. and Kane, S. K. Barrier Pointing: Using Physical Edges to Assist Target Acquisition on Mobile Device Touch Screens. ASSETS 2007, ACM, 19--26.

Digital Library

[12]

Goldberg, D. and Richardson, C. Touch-Typing with a Stylus. CHI 1993, ACM, 80--87.

Digital Library

[13]

Hinckley, K. et al. Pen + Touch = New Tools. UIST 2010, ACM, 27--36.

Digital Library

[14]

Isokoski, P. and Linden, T. Effect of Foreign Language on Text Transcription Performance: Finns Writing English. NordiCHI 2004, ACM, 109--112.

Digital Library

[15]

Kristensson, P. and Zhai, S. SHARK2 : A Large Vocabulary Shorthand Writing System for Pen-based Computers. UIST 2004, ACM, 43--52.

Digital Library

[16]

Kurtenbach, G. and Buxton, W. The Limits of Expert Performance Using Hierarchic Marking Menus. INTERCHI 1993, ACM, 482--487.

Digital Library

[17]

Least Squares Fitting. http://mathworld.wolfram.com/LeastSquaresFitting.html

[18]

Li, F. C. Y. et al. Virtual Shelves: Interactions with Orientation Aware Devices. UIST 2009, ACM, 125--128.

Digital Library

[19]

Lyons, K., et al. Twiddler Typing: One-Handed Chording Text Entry for Mobile Phones. CHI 2004, ACM, 671--678.

Digital Library

[20]

MacKenzie, I. S. KSPC (Keystrokes per Character) as a Characteristic of Text Entry Techniques. HCI with Mobile Devices 2002, Springer-Verlag, 195--210.

Digital Library

[21]

MacKenzie, I. S. and Soukoreff, R. W. A Character-level Error Analysis Technique for Evaluating Text Entry Methods. NordiCHI 2002, ACM, 243--246.

Digital Library

[22]

MacKenzie, I. S. and Soukoreff, R. W. Text Entry for Mobile Computing: Models and Methods, Theory and Practice. HCI 17, (2002), 147--198.

[23]

Mankoff, J. and Abowd, G. D. Cirrin: A Word-level Unistroke Keyboard for Pen Input. UIST 1998, ACM, 213--214.

Digital Library

[24]

McGookin, D., Stephen, B. and WeiWei, J. Investigating Touchscreen Accessibility for People with Visual Impairments. NordiCHI 2008, ACM, 298--307.

Digital Library

[25]

Oulasvirta, A., Tamminen, S., Roto, V. and Kuorelahti, J. Interaction in 4-second Bursts: the Fragmented Nature of Attentional Resources in Mobile HCI. CHI 2005, ACM, 919--928.

Digital Library

[26]

Perlin, K. Quikwriting: Continuous Stylus-based Text Entry. UIST 1998, ACM, 215--216.

Digital Library

[27]

Roth, V. and Turner, T. Bezel Swipe: Conflict-Free Scrolling and Multiple Selection on Mobile Touch Screen Devices. CHI 2009, ACM, 1523--1526.

Digital Library

[28]

Sanchez, J. and Aguayo, F. Mobile Messenger for the Blind. ERCIM 2007, Springer-Verlag, 369--385.

Digital Library

[29]

Sears, A. et al. When Computers Fade: Pervasive Computing and Situationally-induced Impairments and Disabilities. HCI: Theory and Practice 2003, 1298--1302.

[30]

Soukoreff, R. W. and MacKenzie, I. S. Measuring Errors in Text Entry Tasks: An Application of the Levenshtein String Distance Statistic. Ext. Abstracts of CHI 2001, ACM,319--320.

Digital Library

[31]

StreamAnalyzer. http://depts.washington.edu/ewrite/downloads/texteval.zip

[32]

T9 The Global Standard for Mobile Text Input. http://www.nuance.com/for-business/by-product/t9/index.htm

[33]

Tinwala, H. and Mackenzie, I. S. Eyes-free Text Entry on a Touchscreen Phone. TIC-STH 2009, IEEE, 83--89.

[34]

Venolia, D. and Neiberg, F. T-Cube: A Fast, Self-Disclosing Pen-Based Alphabet. CHI 1994, ACM, 265--270.

Digital Library

[35]

Wobbrock, J. O., Myers, B. A. and Kembel, J. A. EdgeWrite: A Stylus-based Text Entry Method Designed for High Accuracy and Stability of Motion. UIST 2003, ACM, 61--70.

Digital Library

[36]

Wobbrock, J. O., Wilson, A. D. and Li, Y. Gestures Without Libraries, Toolkits or Training: a $1 Recognizer for User Interface Prototypes. UIST 2007, ACM, 159--168.

Digital Library

[37]

Yfantidis, G. and Evreinov, G. Adaptive Blind Interaction Technique for Touchscreens. Universal Access in the Information Society 4, 4 (2006), 328--337.

Digital Library

[38]

Zhao, S. and Balakrishnan, R. Simple vs. Compound Mark Hierarchical Marking Menus. UIST 2004, ACM, 33--42.

Digital Library

Cited By

Long TGero KChilton L(2024)Not Just Novelty: A Longitudinal Study on Utility and Customization of an AI WorkflowProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661587(782-803)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661587
Akamine KTsuchida RKato TTamura A(2024)PonDeFlick: A Japanese Text Entry on Smartwatch Commonalizing Flick Operation with Smartphone InterfaceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642569(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642569
Akpinar EYeşilada YKaragöz P(2023)Effect of Context on Smartphone Users’ Typing Performance in the WildACM Transactions on Computer-Human Interaction10.1145/357701330:3(1-44)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3577013
Show More Cited By

Index Terms

User learning and performance with bezel menus
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Zooming user interfaces are increasingly popular on mobile devices with touch screens. Swiping and pinching finger gestures anywhere on the screen manipulate the displayed portion of a page, and taps open objects within the page. This makes navigation ...
No-look flick: single-handed and eyes-free japanese text input system on touch screens of mobile devices
MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

We present a single-handed and eyes-free Japanese kana text input system on touch screens of mobile devices. We first conducted preliminary experiments to investigate the accuracy with which subjects could single-handedly point to and flick without ...
Comparing three novel multimodal touch interfaces for infotainment menus
AutomotiveUI '13: Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Three novel interfaces for navigating a hierarchical menu while driving were experimentally evaluated. Prototypes utilized redundant visual and auditory feedback (multimodal), and were compared to a conventional direct touch interface. All three ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2012

3276 pages

ISBN:9781450310154

DOI:10.1145/2207676

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

55
Total Citations
View Citations
1,055
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Long TGero KChilton L(2024)Not Just Novelty: A Longitudinal Study on Utility and Customization of an AI WorkflowProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661587(782-803)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661587
Akamine KTsuchida RKato TTamura A(2024)PonDeFlick: A Japanese Text Entry on Smartwatch Commonalizing Flick Operation with Smartphone InterfaceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642569(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642569
Akpinar EYeşilada YKaragöz P(2023)Effect of Context on Smartphone Users’ Typing Performance in the WildACM Transactions on Computer-Human Interaction10.1145/357701330:3(1-44)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3577013
Rey BZhu KPerrault SBardot SNeshati AIrani P(2022)Understanding and Adapting Bezel-to-Bezel Interactions for Circular Smartwatches in Mobile and Encumbered ScenariosProceedings of the ACM on Human-Computer Interaction10.1145/35467366:MHCI(1-28)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546736
Safin SMaitrallin MFruchard BLecolinet E(2021)Processus d’appropriation et de mémorisation de raccourcis gestuels sur trackpad : Etude longitudinale des stratégies et usages des utilisateurs et impact d’une aide visuo-sémantiqueProceedings of the 32nd Conference on l'Interaction Homme-Machine10.1145/3450522.3451332(1-12)Online publication date: 13-Apr-2021
https://dl.acm.org/doi/10.1145/3450522.3451332
Rateau HRekik YLank EKatsuragawa K(2021)EdgeMark Menu: A 1D Menu for Curved Edge Display SmartphonesProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472017(1-9)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447526.3472017
India GJain MKarya PDiwakar NSwaminathan M(2021)VStroll: An Audio-based Virtual Exploration to Encourage Walking among People with Vision ImpairmentsProceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3441852.3471206(1-13)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1145/3441852.3471206
Jain MDiwakar NSwaminathan MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Smartphone Usage by Expert Blind UsersProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445074(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445074
Fruchard BLecolinet EChapuis O(2020)Side-Crossing MenusProceedings of the ACM on Human-Computer Interaction10.1145/34273174:ISS(1-19)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.1145/3427317
Akpinar EYeşilada YTemizer S(2020)The Effect of Context on Small Screen and Wearable Device Users’ Performance - A Systematic ReviewACM Computing Surveys10.1145/338637053:3(1-44)Online publication date: 28-May-2020
https://dl.acm.org/doi/10.1145/3386370
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents