Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3328243.3328256acmotherconferencesArticle/Chapter ViewAbstractPublication PageschiuxidConference Proceedingsconference-collections
research-article

Usability Impact of Occlusion-free Techniques on Commonly-used Multitouch Actions

Published: 01 April 2019 Publication History

Abstract

Many interaction techniques have been proposed to combat the finger occlusion and precision problem in multitouch platforms such as tablets and smartphones, supporting more accurate ways to select a target item with a finger. Recognising how the typical touch interactions on multitouch platforms are becoming more complex and composite, in this paper we study some combinations of basic occlusion-free/precision finger interaction techniques in the context of commonly-used composite user actions in realistic usage scenarios including copying and pasting a portion of text and drawing a curved line. We develop full-fledged tablet applications featuring the techniques to assess their usability impact on the rest of the actions. Usability testing with 25 participants qualitatively reveals how the integration of these techniques is useful for their intended part (i.e. accurate targeting) but negatively influence the remaining parts of the action. Insights from the study and areas that will benefit further investigation are discussed.

References

[1]
Pär-Anders Albinsson and Shumin Zhai. 2003. High precision touch screen interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '03), 105--112.
[2]
Oscar Kin-Chung Au, Xiaojun Su and Rynson Lau. 2014. LinearDragger: a linear selector for one-finger target acquisition. In Proceeding Extended Abstracts on Human Factors in Computing Systems. (CHI EA '14), 2607--2616.
[3]
Patrick Baudisch and Gerry Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '09), 1923--1932.
[4]
Patrick Baudisch, Edward Cutrell, Ken Hinckley and Adam Eversole. 2005. Snap-and-go: helping users align objects without the modality of traditional snapping. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '05), 301--310.
[5]
Hrvoje Benko and Daniel Wigdor. 2010. Imprecision, Inaccuracy, and Frustration: The Tale of Touch Input. In: Müller-Tomfelde C. (eds) Tabletops - Horizontal Interactive Displays. Human-Computer Interaction Series. Springer, London. 246--275.
[6]
Hrvoje Benko, Andrew D. Wilson and Patrick Baudisch. 2006. Precise Selection Techniques for Multi-Touch Screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '06), 1263--1272.
[7]
Renaud Blanch, Yves Guiard and Michel Beaudouin-Lafon. 2004. Semantic pointing: improving target acquisition with control-display ratio adaptation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '04), 519--526.
[8]
William Buxton. 1990. A three-state model of graphical input. In Proceedings of the IFIP TC13 Third International Conference on Human-Computer Interaction. (INTERACT '90), 449--456.
[9]
Victor Cheung, Jens Heydekorn, Stacey Scott and Raimund Dachselt. 2012. Revisiting hovering: interaction guides for interactive surfaces. In Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces. (ITS '12), 355--358.
[10]
Katherine Fennedy, Hyowon Lee, Insuk Ko, Yi Ren Tan, Dongliang Zhang and Chunxiao Li. 2018. Augmenting User-Maintained Interaction Through Mode Locking and Reversing. 32nd British Computer Society Human Computer Interaction Conference.
[11]
Clifton Forlines, Chia Shen and Bill Buxton. 2005. Glimpse: a novel input model for multi-level devices. In CHI '05 Extended Abstracts on Human Factors in Computing Systems. (CHI EA '05), 1375--1378. http://0.1145/1056808.1056920
[12]
Clifton Forlines, Daniel Vogel and Ravin Balakrishnan. 2006. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. In Proceedings of the 19th annual ACM symposium on User interface software and technology. (UIST '06), 211--220. http://10.1145/1166253.1166286
[13]
Clifton Forlines, Daniel Wigdor, Chia Shen, and Ravin Balakrishnan. 2007. Direct-touch vs. mouse input for tabletop displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 647--656.
[14]
Cédric Foucault, Manfred Micaux, David Bonnet and Michel Beaudouin-Lafon. 2014. SPad: a bimanual interaction technique for productivity applications on multi-touch tablets. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. (CHI EA '14), 1879--1884.
[15]
Dustin Freeman, Hrvoje Benko, Meredith Ringe Morris and Daniel Wigdor. 2009. ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. (ITS '09), 165--172.
[16]
Alix Goguey, Sylvain Malacria, Carl Gutwin. 2018. Improving Discoverability and Expert Performance in Force-Sensitive Text Selection for Touch Devices with Mode Gauges. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. (CHI '18), 477.
[17]
Alix Goguey, Mathieu Nancel, Géry Casiez, and Daniel Vogel. 2016. The Performance and Preference of Different Fingers and Chords for Pointing, Dragging, and Object Transformation. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4250--4261.
[18]
Tovi Grossman and Ravin Balakrishnan. 2005. The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). ACM, New York, NY, USA, 281--290.
[19]
Tiago Guerreiro, Hugo Nicolau, Joaquim Jorge and Daniel Gonçalves. 2010. Towards accessible touch interfaces. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, (ASSETS '10), 19--26.
[20]
Carl Gutwin, Andy Cockburn, Joey Scarr, Sylvain Malacria and Scott C. Olson. 2014. Faster command selection on tablets with FastTap. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '14), 2617--2626.
[21]
William Hamilton, Andruid Kerne and Tom Robbins. 2012. High-performance pen + touch modality interactions: a real-time strategy game eSports context. In Proceedings of the 25th annual ACM symposium on User interface software and technology. (UIST '12), 309--318.
[22]
Jaehyun Han, Sunggeun Ahn and Geehyuk Lee. 2014. Push-push: a two-point touchscreen operation utilizing the pressed state and the hover state. In Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology. (UIST'14 Adjunct), 103--104.
[23]
Mark S. Hancock and Kellogg S. Booth. 2004. Improving menu placement strategies for pen input. In Proceedings of Graphics Interface 2004. (GI '04), 221--230.
[24]
Ken Hinckley, Seongkook Heo, Michel Pahud, Christian Holz, Hrvoje Benko, Abigail Sellen, Richard Banks, Kenton O'Hara, Gavin Smyth and William Buxton. 2016. Pre-Touch Sensing for Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. (CHI' 16), 2869--2881.
[25]
Ken Hinckley, Francois Guimbretiere, Patrick Baudisch, Raman Sarin, Maneesh Agrawala, and Ed Cutrell. 2006. The springboard: multiple modes in one spring-loaded control. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), ACM, New York, NY, USA, 181--190.
[26]
Amy K. Karlson and Ben Bederson. 2007. Direct Versus Indirect Input Methods for One-Handed Touchscreen Mobile Computing. Technical report, Human-Computer Interaction lab, Computer Science Department, University of Maryland.
[27]
Dominik P. Käser, Maneesh Agrawala and Mark Pauly. 2011. FingerGlass: efficient multiscale interaction on multitouch screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '11), 1601--1610.
[28]
Sunjun Kim, Jihyun Yu and Geehyuk Lee. 2012. Interaction techniques for unreachable objects on the touchscreen. In Proceedings of the 24th Australian Computer-Human Interaction Conference. (OzCHI '12), 295--298.
[29]
Jari Kleimola, Markku Laine, Evgenia Litvinova and Petri Vuorimaa. 2013. TouchModifier: enriched multitouch gestures for tablet browsers. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces. (ITS '13), 445--448.
[30]
Yu Ren Lai and T. K. Philip Hwang. 2015. Virtual Touchpad for Cursor Control of Touchscreen Thumb Operation in the Mobile Context. In: Marcus A. (eds) Design, User Experience, and Usability: Users and Interactions. Lecture Notes in Computer Science, vol. 9187. Springer, Cham.
[31]
Jianwei Lai and Dongsong Zhang. 2014. ExtendedThumb: a motion-based virtual thumb for improving one-handed target acquisition on touchscreen mobile devices. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. (CHI EA '14), 1825--1830.
[32]
David Lee, KyoungHee Son, Joon Hyub Lee and Seok-Hyung Bae. 2012. PhantomPen: virtualization of pen head for digital drawing free from pen occlusion & visual parallax. In Proceedings of the 25th annual ACM symposium on User interface software and technology. (UIST '12), 331--340. http://10.1145/2380116.2380159
[33]
Justin Matejka, Tovi Grossman, Jessica Lo and George Fitzmaurice. 2009. The design and evaluation of multifinger mouse emulation techniques. In Proceeding of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '09), 1073--1082.
[34]
Fabrice Matulic and Moira C. Norrie. 2013. Pen and Touch Gestural Environment for Document Editing on Interactive Tabletops. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS '13), 41--50.
[35]
David C. McCallum and Pourang Irani. 2009. ARC-Pad: Absolute+Relative Cursor Positioning for Large Displays with a Mobile Touchscreen. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. (UIST '09), 153--156. http://10.1145/1622176.1622205
[36]
Mathieu Nancel and Edward Lank. 2017. Modeling User Performance on Curved Constrained Paths. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 244--254.
[37]
Mathieu Nancel, Daniel Vogel and Edward Lank. 2015. Clutching Is Not (Necessarily) the Enemy. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. (CHI '15), 4199--4202.
[38]
Alex Olwal, Steven Feiner, and Susanna Heyman. 2008. Rubbing and tapping for precise and rapid selection on touch-screen displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 295--304.
[39]
Anna Ostberg and Nada Matic. 2015. Hover Cursor: Improving Touchscreen Acquisition Of Small Targets With Hover-enabled Pre-selection. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. (CHI EA '15), 1723--1728. http://10.1145/2702613.2732903
[40]
Ken Pfeuffer, Ken Hinckley, Michel Pahud and Bill Buxton. 2017. Thumb+ Pen Interaction on Tablets. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. (CHI '17), 3254--3266.
[41]
Richard L. Potter, Linda J. Weldon and Ben Shneiderman. 1988. Improving The Accuracy of Touch Screens: An Experimental Evaluation of Three Strategies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '88) 27--32.
[42]
Anne Roudaut, Stéphane Huot and Eric Lecolinet. 2008. TapTap and MagStick: Improving One-Handed Target Acquisition on small touch-screens. In Proceedings of the working conference on Advanced visual interfaces. (AVI '08), 146--153.
[43]
Andrew Sears and Ben Shneiderman.1991. High Precision Touchscreens: Design Strategies and Comparisons with a Mouse. International Journal of Man-Machine 34, 4: 593--613.
[44]
Hemant Bhaskar Surale, Fabrice Matulic, and Daniel Vogel. 2017. Experimental Analysis of Mode Switching Techniques in Touch-based User Interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3267--3280.
[45]
Md. Sami Uddin, Carl Gutwin and Benjamin Lafreniere. 2016. HandMark Menus: Rapid Command Selection and Large Command Sets on Multi- Touch Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5836--5848.
[46]
Daniel Vogel and Ravin alakrishnan. 2010. Direct Pen Interaction With a Conventional Graphical User Interface. In Human-Computer Interaction 25, 4: 324--388.
[47]
Daniel Vogel and Ravin Balakrishnan. 2010. Occlusion-aware interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '10), 263--272.
[48]
Daniel Vogel and Patrick Baudisch. 2007. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '07), 657--666. http://0.1145/1240624.1240727
[49]
Chat Wacharamanotham, Jan Hurtmanns, Alexander Mertens, Martin Kronenbuerger, Christopher Schlick and Jan Borchers. 2011. Evaluating swabbing: a touchscreen input method for elderly users with tremor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. (CHI '11), 623--626. http://10.1145/1978942.1979031
[50]
Feng Wang, Xiang Cao, Xiangshi Ren and Pourang Irani. 2009. Detecting and Leveraging Finger Orientation for Interaction with Direct-Touch Surfaces. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. (UIST '09), 23--32.
[51]
Daniel Wigdor, Clifton Forlines, Patrick Baudisch, John Barnwell and Chia Shen. 2007. Lucid Touch: a see-through mobile device. In Proceedings of the 20th annual ACM symposium on User interface software and technology. (UIST '07), 269--278.
[52]
Katrin Wolf and Niels Henze. 2014. Comparing pointing techniques for grasping hands on tablets. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services. (MobileHCI '14), 53--62.
[53]
Koji Yatani, Kurt Partridge, Marshall Bern, and Mark W. Newman. 2008. Escape: a target selection technique using visually-cued gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 285--294.
[54]
Stanislaw Zabramski, Suman Shrestha, and Wolfgang Stuerzlinger. 2013. Easy vs. Tricky: The Shape Effect in Tracing, Selecting, and Steering With Mouse, Stylus, and Touch. In Proceedings of International Conference on Making Sense of Converging Media (AcademicMindTrek '13), Artur Lugmayr, Heljä Franssila, Janne Paavilainen, and Hannu Kärkkäinen (Eds.). ACM, New York, NY, USA, Pages 99, 5 pages.

Cited By

View all
  • (2021)VRSketch: Investigating 2D Sketching in Virtual Reality with Different Levels of Hand and Pen TransparencyHuman-Computer-Interaction – INTERACT 202110.1007/978-3-030-85607-6_14(195-211)Online publication date: 27-Aug-2021

Index Terms

  1. Usability Impact of Occlusion-free Techniques on Commonly-used Multitouch Actions

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    CHIuXiD'19: Proceedings of the 5th International ACM In-Cooperation HCI and UX Conference
    April 2019
    205 pages
    ISBN:9781450361873
    DOI:10.1145/3328243
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 April 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Interaction design
    2. finger occlusion
    3. multitouch

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    CHIuXiD'19
    CHIuXiD'19: The 5th International HCI and UX Conference
    April 1 - 9, 2019
    Surabaya, Bali, Jakarta, Indonesia

    Acceptance Rates

    Overall Acceptance Rate 22 of 50 submissions, 44%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)9
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)VRSketch: Investigating 2D Sketching in Virtual Reality with Different Levels of Hand and Pen TransparencyHuman-Computer-Interaction – INTERACT 202110.1007/978-3-030-85607-6_14(195-211)Online publication date: 27-Aug-2021

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media