research-article

EdgeMark Menu: A 1D Menu for Curved Edge Display Smartphones

Authors:

Keiko KatsuragawaAuthors Info & Claims

MobileHCI '21: Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction

Article No.: 7, Pages 1 - 9

https://doi.org/10.1145/3447526.3472017

Published: 27 September 2021 Publication History

Abstract

While many smartphones now include a waterfall (or curved edge) display, this edge is rarely exploited for input. In this paper, we introduce EdgeMark, a thumb-operated, one-handed, gestural menu to provide rapid and subtle access to commands. In a first study, we assess the movement range of the user during uni-manual input to define a spatial range for our EdgeMark menu. In a second study, we compare three potential EdgeMark designs to a marking menu variant to assess accuracy and performance. Our findings indicate that EdgeMark menus can serve as a reliable, effective mechanism for subtle, one-hand command invocation in modern, waterfall-edged smartphones.

References

[1]

Gilles Bailly, Robert Walter, Jörg Müller, Tongyan Ning, and Eric Lecolinet. 2011. Comparing Free Hand Menu Techniques for Distant Displays Using Linear, Marking and Finger-Count Menus. In Human-Computer Interaction – INTERACT 2011, Pedro Campos, Nicholas Graham, Joaquim Jorge, Nuno Nunes, Philippe Palanque, and Marco Winckler(Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 248–262.

[2]

Olivier Bau and Wendy E. Mackay. 2008. OctoPocus: A Dynamic Guide for Learning Gesture-Based Command Sets. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology(Monterey, CA, USA) (UIST ’08). Association for Computing Machinery, New York, NY, USA, 37–46. https://doi.org/10.1145/1449715.1449724

Digital Library

[3]

Thomas Baudel and Michel Beaudouin-Lafon. 1993. Charade: Remote Control of Objects Using Free-Hand Gestures. Commun. ACM 36, 7 (July 1993), 28–35. https://doi.org/10.1145/159544.159562

Digital Library

[4]

David Bonnet and Caroline Appert. 2011. SAM: The Swiss Army Menu. In Proceedings of the 23rd Conference on l’Interaction Homme-Machine (Sophia Antipolis, France) (IHM ’11). Association for Computing Machinery, New York, NY, USA, Article 5, 4 pages. https://doi.org/10.1145/2044354.2044361

Digital Library

[5]

Andrew Bragdon, Eugene Nelson, Yang Li, and Ken Hinckley. 2011. Experimental Analysis of Touch-Screen Gesture Designs in Mobile Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 403–412. https://doi.org/10.1145/1978942.1979000

Digital Library

[6]

Andrew Bragdon, Robert Zeleznik, Brian Williamson, Timothy Miller, and Joseph J. LaViola. 2009. GestureBar: Improving the Approachability of Gesture-Based Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 2269–2278. https://doi.org/10.1145/1518701.1519050

Digital Library

[7]

Christian Corsten, Marcel Lahaye, Jan Borchers, and Simon Voelker. 2019. ForceRay: Extending Thumb Reach via Force Input Stabilizes Device Grip for Mobile Touch Input. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300442

Digital Library

[8]

Rana Mohamed Eisa, Yassin El-Shanwany, Yomna Abdelrahman, and Wael Abouelsadat. 2017. LINEUp: List Navigation Using Edge Menu. In International Conference on Intelligent Human Computer Interaction. Springer, Cham, 86–106.

[9]

Jérémie Francone, Gilles Bailly, Eric Lecolinet, Nadine Mandran, and Laurence Nigay. 2010. Wavelet Menus on Handheld Devices: Stacking Metaphor for Novice Mode and Eyes-Free Selection for Expert Mode. In Proceedings of the International Conference on Advanced Visual Interfaces (Roma, Italy) (AVI ’10). Association for Computing Machinery, New York, NY, USA, 173–180. https://doi.org/10.1145/1842993.1843025

Digital Library

[10]

Carl Gutwin, Andy Cockburn, Joey Scarr, Sylvain Malacria, and Scott C. Olson. 2014. Faster Command Selection on Tablets with FastTap. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 2617–2626. https://doi.org/10.1145/2556288.2557136

Digital Library

[11]

Teng Han, Jiannan Li, Khalad Hasan, Keisuke Nakamura, Randy Gomez, Ravin Balakrishnan, and Pourang Irani. 2018. PageFlip: Leveraging Page-Flipping Gestures for Efficient Command and Value Selection on Smartwatches. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174103

[12]

Khalad Hasan, David Ahlström, and Pourang Irani. 2013. Ad-Binning: Leveraging around Device Space for Storing, Browsing and Retrieving Mobile Device Content. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 899–908. https://doi.org/10.1145/2470654.2466115

Digital Library

[13]

Khalad Hasan, Junhyeok Kim, David Ahlström, and Pourang Irani. 2016. Thumbs-Up: 3D Spatial Thumb-Reachable Space for One-Handed Thumb Interaction on Smartphones. In Proceedings of the 2016 Symposium on Spatial User Interaction (Tokyo, Japan) (SUI ’16). Association for Computing Machinery, New York, NY, USA, 103–106. https://doi.org/10.1145/2983310.2985755

Digital Library

[14]

Stéphane Huot and Eric Lecolinet. 2007. ArchMenu et ThumbMenu: ContrôLer Son Dispositif Mobile « Sur Le Pouce ». In Proceedings of the 19th Conference on l’Interaction Homme-Machine (Paris, France) (IHM ’07). Association for Computing Machinery, New York, NY, USA, 107–110. https://doi.org/10.1145/1541436.1541457

Digital Library

[15]

Mohit Jain and Ravin Balakrishnan. 2012. User Learning and Performance with Bezel Menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 2221–2230. https://doi.org/10.1145/2207676.2208376

Digital Library

[16]

Kenrick Kin, Björn Hartmann, and Maneesh Agrawala. 2011. Two-Handed Marking Menus for Multitouch Devices. ACM Trans. Comput.-Hum. Interact. 18, 3, Article 16 (Aug. 2011), 23 pages. https://doi.org/10.1145/1993060.1993066

Digital Library

[17]

Sven Kratz and Michael Rohs. 2009. HoverFlow: Expanding the Design Space of around-Device Interaction. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (Bonn, Germany) (MobileHCI ’09). Association for Computing Machinery, New York, NY, USA, Article 4, 8 pages. https://doi.org/10.1145/1613858.1613864

Digital Library

[18]

Per Ola Kristensson and Shumin Zhai. 2007. Command Strokes with and without Preview: Using Pen Gestures on Keyboard for Command Selection. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 1137–1146. https://doi.org/10.1145/1240624.1240797

Digital Library

[19]

Gordon Kurtenbach and William Buxton. 1993. The limits of expert performance using hierarchic marking menus. In Proceedings of the INTERACT’93 and CHI’93 conference on Human factors in computing systems. 482–487.

Digital Library

[20]

Gordon Kurtenbach, George W. Fitzmaurice, Russell N. Owen, and Thomas Baudel. 1999. The Hotbox: Efficient Access to a Large Number of Menu-Items. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI ’99). Association for Computing Machinery, New York, NY, USA, 231–237. https://doi.org/10.1145/302979.303047

Digital Library

[21]

Gordon Paul Kurtenbach. 1993. The design and evaluation of marking menus.University of Toronto Toronto.

[22]

Wing Ho Andy Li, Kening Zhu, and Hongbo Fu. 2017. Exploring the Design Space of Bezel-Initiated Gestures for Mobile Interaction. Int. J. Mob. Hum. Comput. Interact. 9, 1 (Jan. 2017), 16–29. https://doi.org/10.4018/IJMHCI.2017010102

[23]

Yang Li. 2010. Gesture Search: A Tool for Fast Mobile Data Access. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). Association for Computing Machinery, New York, NY, USA, 87–96. https://doi.org/10.1145/1866029.1866044

Digital Library

[24]

Hanae Rateau, Yosra Rekik, Edward Lank, and Laurent Grisoni. 2018. Ether-Toolbars: Evaluating Off-Screen Toolbars for Mobile Interaction. In 23rd International Conference on Intelligent User Interfaces (Tokyo, Japan) (IUI ’18). Association for Computing Machinery, New York, NY, USA, 487–495. https://doi.org/10.1145/3172944.3172978

Digital Library

[25]

Karsten Seipp and Kate Devlin. 2013. Enhancing One-Handed Website Operation on Touchscreen Mobile Phones. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA ’13). Association for Computing Machinery, New York, NY, USA, 3123–3126. https://doi.org/10.1145/2468356.2479626

[26]

Marcos Serrano, Eric Lecolinet, and Yves Guiard. 2013. Bezel-Tap Gestures: Quick Activation of Commands from Sleep Mode on Tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 3027–3036. https://doi.org/10.1145/2470654.2481421

Digital Library

[27]

Sony. 2019. Using Side-Sense. https://helpguide.sony.net/mobile/xperia-5/v1/en/contents/using-side-sense.html. Accessed: 2021-03-23.

[28]

Kiseok Sung, Jay Cho, and Andris Freivalds. 2016. Effects of grip span in one-handed thumb interaction with a smartphone: Beyond the thumb’s length limitation. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 60. SAGE Publications Sage CA: Los Angeles, CA, 1048–1052.

[29]

Simon Voelker, Sebastian Hueber, Christian Corsten, and Christian Remy. 2020. HeadReach: Using Head Tracking to Increase Reachability on Mobile Touch Devices. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376868

Digital Library

[30]

Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-Defined Gestures for Surface Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 1083–1092. https://doi.org/10.1145/1518701.1518866

Digital Library

[31]

Hsi-Hsun Yang, Zheng-Nan Chen, and Chung-Wen Hung. 2017. Performance of smartphone users with half-pie and linear menus. Behaviour & Information Technology 36, 9 (2017), 935–954.

Digital Library

[32]

Shumin Zhai, Per Ola Kristensson, Caroline Appert, Tue Haste Andersen, and Xiang Cao. 2012. Foundational Issues in Touch-Screen Stroke Gesture Design - An Integrative Review. Foundations and Trends in Human-Computer Interaction 5, 2 (Dec. 2012), 97–205. https://doi.org/10.1561/1100000012

Digital Library

[33]

Shengdong Zhao and Ravin Balakrishnan. 2004. Simple vs. Compound Mark Hierarchical Marking Menus. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (Santa Fe, NM, USA) (UIST ’04). Association for Computing Machinery, New York, NY, USA, 33–42. https://doi.org/10.1145/1029632.1029639

Digital Library

[34]

Jingjie Zheng, Xiaojun Bi, Kun Li, Yang Li, and Shumin Zhai. 2018. M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173823

Digital Library

Cited By

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508

Recommendations

Improving menu interaction: a comparison of standard, force enhanced and jumping menus
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper we show how a model centered analysis of the usage of the mouse click interaction action in graphical user interfaces can be used to create a new menu system. The analysis identifies a possible new usage of the click action in cascading ...
MultiTouch menu (MTM)
IHM '08: Proceedings of the 20th Conference on l'Interaction Homme-Machine

This paper describes a new menu technique called MultiTouch Menu, that is especially well suited for multitouch interactive surfaces. In contrast with traditional menu techniques, the MultiTouch menu makes the most of the new capabilities provided by ...
Non-Visual Menu Navigation: the Effect of an Audio-Tactile Display
BCS-HCI '14: Proceedings of the 28th International BCS Human Computer Interaction Conference on HCI 2014 - Sand, Sea and Sky - Holiday HCI

We present a preliminary study examining non-visual menu navigation in terms of task completion times and cognitive workload. We asked 12 participants to locate items on menus presented using visual, audio-only and audio-tactile displays on a touch ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '21: Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction

September 2021

637 pages

ISBN:9781450383288

DOI:10.1145/3447526

Copyright © 2021 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was co-authored by an affiliate of the Canadian National Government. As such, the Crown in Right of Canada retains an equal interest in the copyright. Reprint requests should be forwarded to ACM, and reprints must include clear attribution to ACM and National Research Council Canada -NRC.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Research Council Canada

Conference

MobileHCI '21

Sponsor:

SIGCHI

MobileHCI '21: 23rd International Conference on Mobile Human-Computer Interaction

September 27 - October 1, 2021

Toulouse & Virtual, France

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
213
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)4

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents