research-article

Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces

Authors:

Xiaolong Zhang,

Guozhong DaiAuthors Info & Claims

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1371 - 1380

https://doi.org/10.1145/1357054.1357269

Published: 06 April 2008 Publication History

Abstract

We present a new technique called 'Tilt Menu' for better extending selection capabilities of pen-based interfaces. The Tilt Menu is implemented by using 3D orientation information of pen devices while performing selection tasks. The Tilt Menu has the potential to aid traditional one-handed techniques as it simultaneously generates the secondary input (e.g., a command or parameter selection) while drawing/interacting with a pen tip without having to use the second hand or another device. We conduct two experiments to explore the performance of the Tilt Menu. In the first experiment, we analyze the effect of parameters of the Tilt Menu, such as the menu size and orientation of the item, on its usability. Results of the first experiment suggest some design guidelines for the Tilt Menu. In the second experiment, the Tilt Menu is compared to two types of techniques while performing connect-the-dot tasks using freeform drawing mechanism. Results of the second experiment show that the Tilt Menu perform better in comparison to the Tool Palette, and is as good as the Toolglass.

References

[1]

Adobe Illustrator, http://www.adobe.com/products/illustrator/

[2]

Accot, J., Zhai, S., Beyond Fitts' Law: Models for Trajectory-Based HCI Tasks. In Proc. CHI 1997, ACM Press (1997), 295--302.

Digital Library

[3]

Arvo, J., Novins, K., Fluid Sketches: Continuous Recognition and Morphing of Simple Hand-Drawn Shapes. In Proc. UIST 2000, ACM Press (2000), 73--80.

Digital Library

[4]

Balakrishnan, R., Baudel, T., Kurtenbach, G., and Fitzmaurice, G., The Rockin'Mouse: integral 3D manipulation on a plane. In Proc. CHI 1997, ACM Press (1997), 311--318.

Digital Library

[5]

Balakrishnan, R., Hinckley, K., The role of kinesthetic reference frames in two-handed input performance. In Proc. UIST 1999, ACM Press (1999), 171--178.

Digital Library

[6]

Bier, E. A., Stone, M. C., Pier, K., Buxton, W., Derose, T. D., Toolglass and magic lenses: The see-through interface. In Proc. SIGGRAPH 1993, 73--80.

Digital Library

[7]

Callahan, J., Hopkins, D., Weiser, M., Shneiderman, B., An empirical comparison of pie vs. linear menus. In Proc. of CHI 1988, ACM Press (1988), 95--100.

Digital Library

[8]

Fitzmaurice, G., Khan, A., Pieké, R., Buxton, W., Kurtenbach, G., Tracking menus. In Proc UIST 2003, ACM Press (2003), 71--79.

Digital Library

[9]

Franke, K., The influence of physical and biomechanical processes on the ink trace methodological foundations for the forensic analysis of signatures, Ph.D. thesis, University of Groningen, The Netherlands, 2005.

[10]

Grossman T, Hinckley, K. Baudisch, P., Agrawala, M., Balakrishnan, R., Hover widgets: Using the tracking state to extend the capabilities of pen-operated devices. In Proc. CHI 2006, ACM Press (2006), 861--860.

Digital Library

[11]

Guimbretière, F., Winograd, T. FlowMenu: Combining command, text, and parameter entry. In Proc UIST 2000, ACM Press (2000). 213--216.

Digital Library

[12]

Guimbretière, F., Martin, A., Winograd, T., Benefits of merging command selection and direct manipulation. ACM TOCHI, 2005, 12 (3): 460--476.

Digital Library

[13]

Hinckley, K., Guimbretiere, F., Agrawala, M., Apitz, G., Chen, N., Phrasing techniques for multi-stroke selection gestures. GI, 147--154.

Digital Library

[14]

Jacob, R.J.K., Deligiannidis, L., Morrison, S., A Software Model and Specification Language for Non-WIMP User Interfaces. ACM TOCHI, 1999, 6(1): 1--46.

Digital Library

[15]

Jagadeesh Babu V., Prashanth L., Raghunath Sharma R., Prabhakara Rao G.V., Bharath A., HMM-based Online Handwriting Recognition System for Telugu Symbols, In Proc. ICDAR 2007, 23--26

Digital Library

[16]

Kabbash, P., Buxton, W., Sellen, A., Two-handed input in a compound task. In Proc. CHI 1994, ACM Press (1994), 417--423.

Digital Library

[17]

Kurtenbach, G. Buxton, W., The limits of expert performance using hierarchical marking menus. In Proc. CHI 1992, ACM Press (1992), 482--487.

Digital Library

[18]

Kurtenbach, G., Sellen, A., Buxton, W., An empirical evaluation of some articulatory and cognitive aspects of "marking menus". Human Computer Interaction, 1993. 8(1): 1--23.

Digital Library

[19]

Li, J., Zhang, X., Ao X., Dai G., Sketch recognition with continuous feedback based on incremental intention extraction, In Proc IUI 2005, ACM Press (2005), 145--150.

Digital Library

[20]

Li, Y., Hinckley, K., Guan Z., Landay, J.A., Experimental analysis of mode switching techniques in pen based user interfaces. In Proc. CHI 2005, ACM Press (2005), 461--470.

Digital Library

[21]

Odell, D., Davis, R., Smith, A., Wright, P. K., Toolglasses, Marking Menus, and Hotkeys: A Comparison of One and Two-Handed Command Selection Techniques, In Proc. GI 2004, 17--24.

Digital Library

[22]

Partridge, K., Chatterjee, S., Want, R., TiltType: Accelerometer-supported text entry for very small devices, In Proc. CHI 2001, ACM Press (2001), 201--204.

Digital Library

[23]

Pook, S., Lecolinet, E., Vaysseix, G., and Barillot, E., Control menu: Execution and control in a single interactor. In Proc. CHI 2000, ACM Press (2000), 263--264.

Digital Library

[24]

Solidworks, http://www.solidworks.com

[25]

Ramos, G., Boulos, M., Balakrishnan, R. Pressure Widgets. In Proc. CHI 2004, ACM Press (2004), 487--494.

Digital Library

[26]

Ramos, G., Balakrishnan, R. Zliding: fluid zooming and sliding for high precision parameter manipulation. In Proc. UIST 2005, ACM Press (2005), 143--152.

Digital Library

[27]

Ramos, G., Balakrishnan, R. Pressure Marks. In Proc. CHI 2007, ACM Press (2007), 1375--1384.

Digital Library

[28]

Saund, E., Lank, E., Stylus input and editing without prior selection of mode. In Proc. UIST 2003, ACM Press (2003), 213--216.

Digital Library

[29]

Tandler, P., Prante, T., Using Incremental Gesture Recognition to Provide Immediate Feedback while Drawing Pen Gestures. In Proc. UIST 2001, ACM Press (2001), 18--25.

[30]

Tian, F., Ao, X., Wang, H., Setlur, V., Dai G., The Tilt Cursor: Enhancing Stimulus-Response Compatibility Based on 3D Orientation Cue of Pen Devices. In Proc. CHI 2007, ACM Press (2007), 303--306.

Digital Library

[31]

Wigdor, D., Balakrishnan, R. TiltText: Using Tilt. for Text Input to Mobile Phones. In Proc. UIST 2003. ACM Press (2003), 81--90.

Digital Library

[32]

Zhao, S., Agrawala, M., Hinckley, K., Zone and Polygon Menus: Using Relative Position to Increase the Breadth of Multi-Stroke Marking. Menus, In Proc. CHI 2006, ACM Press (2006), 1077--1086.

Digital Library

Cited By

Fender AKari M(2024)OptiBasePen: Mobile Base+Pen Input on Passive Surfaces by Sensing Relative Base Motion Plus Close-Range Pen PositionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676467(1-9)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676467
Kong DWang HZhou SCui HFeng Z(2024)PenLab: Towards Understanding of Active Collaboration for Solid Geometry TeachingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650789(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650789
Yu JNai WSun X(2024)Accurate Raycasting Selection With Rotation Gesture Using a 6-DOF Tracking DeviceIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332437330:9(6104-6117)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3324373
Show More Cited By

Index Terms

Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
    2. Interaction paradigms
      1. Graphical user interfaces
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

The tilt cursor: enhancing stimulus-response compatibility by providing 3d orientation cue of pen
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In order to improve stimulus-response compatibility of touchpad in pen-based user interface, we present the tilt cursor, i.e. a cursor dynamically reshapes itself to providing the 3D orientation cue of pen. We also present two experiments that evaluate ...
Multitouch Radial Menu Integrating Command Selection and Control of Arguments with up to 4 Degrees of Freedom
AVI '16: Proceedings of the International Working Conference on Advanced Visual Interfaces

We design and evaluate a multitouch radial menu for large screens with two desirable properties. First, it allows a single gesture to select a command and then continuously control arguments for that command with unbroken kinesthetic tension. Second, ...
ARPen: Mid-Air Object Manipulation Techniques for a Bimanual AR System with Pen & Smartphone
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Modeling in Augmented Reality (AR) lets users create and manipulate virtual objects in mid-air that are aligned to their real environment. We present ARPen, a bimanual input technique for AR modeling that combines a standard smartphone with a 3D-printed ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2008

1870 pages

ISBN:9781605580111

DOI:10.1145/1357054

General Chairs:
Mary Czerwinski
Microsoft Research, USA
,
Arnie Lund
Microsoft, USA
,
Program Chair:
Desney Tan
Microsoft Research, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '08

Sponsor:

CHI '08: CHI Conference on Human Factors in Computing Systems

April 5 - 10, 2008

Florence, Italy

Acceptance Rates

CHI '08 Paper Acceptance Rate 157 of 714 submissions, 22%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

57
Total Citations
View Citations
1,328
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)4

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fender AKari M(2024)OptiBasePen: Mobile Base+Pen Input on Passive Surfaces by Sensing Relative Base Motion Plus Close-Range Pen PositionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676467(1-9)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676467
Kong DWang HZhou SCui HFeng Z(2024)PenLab: Towards Understanding of Active Collaboration for Solid Geometry TeachingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650789(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650789
Yu JNai WSun X(2024)Accurate Raycasting Selection With Rotation Gesture Using a 6-DOF Tracking DeviceIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332437330:9(6104-6117)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3324373
Zou QBai HGao LLee GFowler ABillinghurst M(2023)Stylus and Gesture Asymmetric Interaction for Fast and Precise Sketching in Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.227829440:23(8124-8141)Online publication date: 15-Nov-2023
https://doi.org/10.1080/10447318.2023.2278294
Lüthi GFender AHolz C(2022)DeltaPen: A Device with Integrated High-Precision Translation and Rotation Sensing on Passive SurfacesProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545655(1-12)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545655
Biener VGesslein TSchneider DKawala FOtte AKristensson PPahud MOfek ECampos CKljun MPucihar KGrubert J(2022)PoVRPoint: Authoring Presentations in Mobile Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.315047428:5(2069-2079)Online publication date: May-2022
https://doi.org/10.1109/TVCG.2022.3150474
Zou QBai HZhang YLee GAllan FMark B(2021)Tool-based Asymmetric Interaction for Selection in VRSIGGRAPH Asia 2021 Technical Communications10.1145/3478512.3488615(1-4)Online publication date: 14-Dec-2021
https://dl.acm.org/doi/10.1145/3478512.3488615
Chen JYu FYu JLin L(2021)A Three-Dimensional Pen-Like Ultrasonic Positioning System Based on Quasi-Spherical PVDF Ultrasonic TransmitterIEEE Sensors Journal10.1109/JSEN.2020.301629221:2(1756-1763)Online publication date: 15-Jan-2021
https://doi.org/10.1109/JSEN.2020.3016292
Guerrero APietrzak TGirouard A(2021)HyperBrush: Exploring the Influence of Flexural Stiffness on the Performance and Preference for Bendable Stylus InterfacesHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85610-6_4(51-71)Online publication date: 30-Aug-2021
https://dl.acm.org/doi/10.1007/978-3-030-85610-6_4
Matulic FVogel D(2021)Deep Learning-Based Hand Posture Recognition for Pen Interaction EnhancementArtificial Intelligence for Human Computer Interaction: A Modern Approach10.1007/978-3-030-82681-9_7(193-225)Online publication date: 5-Nov-2021
https://doi.org/10.1007/978-3-030-82681-9_7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents