research-article

Harpoon selection: efficient selections for ungrouped content on large pen-based surfaces

Authors:

Michael HallerAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

Pages 593 - 602

https://doi.org/10.1145/2047196.2047275

Published: 16 October 2011 Publication History

Abstract

In this paper, we present the Harpoon selection tool, a novel selection technique specifically designed for interactive whiteboards. The tool combines area cursors and crossing to perform complex selections amongst a large number of unsorted, ungrouped items. It is optimized for large-scale pen-based surfaces and works well in both dense and sparse surroundings. We describe a list of key features relevant to the design of the tool and provide a detailed description of both the mechanics as well as the feedback of the tool. The results of a user study are described and analyzed to confirm our design. The study shows that the Harpoon tool performs significantly faster than Tapping and Lassoing.

Supplementary Material

JPG File (fp238.jpg)

Download
17.87 KB

WMV File (fp238.wmv)

Download
43.83 MB

References

[1]

Accot, J. and Zhai, S. 1997. Beyond Fitts' law: models for trajectory-based HCI tasks. In CHI '97, Steven Pemberton (Ed.). ACM, New York, NY, USA, 295--302.

Digital Library

[2]

Accot, J. and Zhai, S. 2002. More than dotting the i's - foundations for crossing-based interfaces. In CHI '02. ACM, New York, NY, USA, 73--80.

Digital Library

[3]

Apitz, G., Guimbretière, F. and Zhai, S. 2008. Founda-tions for designing and evaluating user interfaces based on the crossing paradigm. ACM Trans. Comput.-Hum. Interact. 17, 2, Article 9 (May 2008), 42 pages.

Digital Library

[4]

Brewster, S.A. 1998. Using Earcons to Improve the Usability of a Graphics Package. In HCI '98, Hilary Johnson, Laurence Nigay, and Chris Roast (Eds.). Springer-Verlag, London, UK, 287--302.

Digital Library

[5]

Buxton, W., Fiume, E., Hill, R., Lee, A. and Woo, C. 1983. Continuous Hand-Gesture Driven Input. Graphic Interface. 191--195.

[6]

Chapuis, O., Labrune, JB. and Pietriga E. 2009. DynaSpot: speed-dependent area cursor. In CHI '09. ACM, New York, NY, USA, 1391--1400.

Digital Library

[7]

Fitzmaurice, G., Khan, A., Piek R., Buxton, W. and Kurtenbach, G. 2003. Tracking menus. In UIST '03. ACM, New York, NY, USA, 71--79.

Digital Library

[8]

Grossman, T., Baudisch, P., and Hinckley, K. 2009. Handle Flags: efficient and flexible selections for inking applications. In GI '09. Canada, 167--174.

Digital Library

[9]

Guimbretière, F., Stone, M., and Winograd, T. 2001. Fluid interaction with high-resolution wall-size displays. In UIST '01. ACM, New York, NY, USA, 21--30.

Digital Library

[10]

Haller, M., Leitner, J., Seifried, T., Wallace, J. R., Scott, S. D., Richter, C., Brandl, P., Gokcezade, A., Hunter, S., 2010. The NiCE Discussion Room: Integrating Paper and Digital Media to Support Co-Located Group Meetings. In CHI '10, ACM, New York, NY, USA, 609--618.

Digital Library

[11]

1Hinckley, K., Baudisch, P., Ramos, G., and Guimbretiere, F. 2005. Design and analysis of delimiters for se-lection-action pen gesture phrases in scriboli. In CHI '05. ACM, New York, NY, USA, 451--460.

Digital Library

[12]

Kabbash, P. and Buxton, W. 1995. The "prince" technique: Fitts' law and selection using area cursors. In CHI '95, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 273--279.

Digital Library

[13]

Kurtenbach, G. and Buxton, W. 1991. Issues in combining marking and direct manipulation techniques. In UIST '91. ACM, New York, NY, USA, 137--144.

Digital Library

[14]

Lank, E. and Saund, E. 2005. Sloppy Selection: Providing an Accurate Interpretation of Imprecise Stylus Selection Gestures. Computers and Graphics. 29(4): 490--500.

Digital Library

[15]

Mizobuchi, S. and Yasumura, M. 2004. Tapping vs. circling selections on pen-based devices: evidence for different performance-shaping factors. In CHI '04. ACM, New York, NY, USA, 607--614.

Digital Library

[16]

Moran, T.P., Chiu, P. and Melle, W. 1997. Pen-based interaction techniques for organizing material on an electronic whiteboard. In UIST '97. ACM, New York, NY, USA, 45--54.

Digital Library

[17]

Plamondon, R. and Srihari, S. 2000. On-line and Offline Handwriting Recognition: A Comprehensive Survey. IEEE Pattern Analysis. 22(1), 63--84.

Digital Library

[18]

Rekimoto, J. 1997. Pick-and-drop: a direct manipulation technique for multiple computer environments. In UIST '97. ACM, New York, NY, USA, 31--39.

Digital Library

[19]

Ren, X., and Moriya, S. 2000. Improving selection performance on pen-based systems: a study of pen-based interaction for selection tasks. ACM Trans. Comput.-Hum. Interact. 7, 3,384--416.

Digital Library

[20]

Saund, E. and Lank, E. 2003. Stylus input and editing without prior selection of mode. In UIST '03. ACM, New York, NY, USA, 213--216.

Digital Library

[21]

2Saund, E., Mahoney, J., Fleet, D., Larner, D. and Lank, E. 2002. Perceptual Organization as a Foundation for Intelligent Sketch Editing. AAAI Symposium on Sketch Understanding. 118--125.

[22]

2Yin, J. and Ren, X. 2007. Investigation to line-based techniques for multi-target selection. In INTERACT'07, Springer-Verlag, Berlin, Heidelberg, 507--510.

Digital Library

Cited By

Shi LCampbell RChi PCirimele MCleron MClimer KFleming CGanti AGervais PGonnet PKarim TMaksai AMelancon CMickle RMusat CNandy PQu XRobishaw DSingh AVenkatesan M(2024)Inkeraction: An Interaction Modality Powered by Ink Recognition and SynthesisProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642498(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642498
Romat HMarquardt NHinckley KHenry Riche N(2022)Style Blink: Exploring Digital Inking of Structured Information via Handcrafted Styling as a First-Class ObjectProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501988(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501988
Usuba HYamanaka SMiyashita HLee BLee GScott STory MKim J(2019)Comparing Lassoing Criteria and Modeling Straight-line and One-loop Lassoing Motions Considering CriteriaProceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces10.1145/3343055.3359707(181-191)Online publication date: 10-Nov-2019
https://dl.acm.org/doi/10.1145/3343055.3359707
Show More Cited By

Index Terms

Harpoon selection: efficient selections for ungrouped content on large pen-based surfaces
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Crossing-based selection with direct touch input
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Fundamental performance results for crossing-based selec-tion tasks with direct touch input are presented. A close adaptation of Accot and Zhai's indirect stylus crossing ex-periment reveals similar trends for direct touch input: touch crossing task ...
B2B-Swipe: Swipe Gesture for Rectangular Smartwatches from a Bezel to a Bezel
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

We present B2B-Swipe, a single-finger swipe gesture for a rectangular smartwatch that starts at a bezel and ends at a bezel to enrich input vocabulary. There are 16 possible B2B-Swipes because a rectangular smartwatch has four bezels. Moreover, B2B-...
Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Zooming user interfaces are increasingly popular on mobile devices with touch screens. Swiping and pinching finger gestures anywhere on the screen manipulate the displayed portion of a page, and taps open objects within the page. This makes navigation ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
799
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shi LCampbell RChi PCirimele MCleron MClimer KFleming CGanti AGervais PGonnet PKarim TMaksai AMelancon CMickle RMusat CNandy PQu XRobishaw DSingh AVenkatesan M(2024)Inkeraction: An Interaction Modality Powered by Ink Recognition and SynthesisProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642498(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642498
Romat HMarquardt NHinckley KHenry Riche N(2022)Style Blink: Exploring Digital Inking of Structured Information via Handcrafted Styling as a First-Class ObjectProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501988(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501988
Usuba HYamanaka SMiyashita HLee BLee GScott STory MKim J(2019)Comparing Lassoing Criteria and Modeling Straight-line and One-loop Lassoing Motions Considering CriteriaProceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces10.1145/3343055.3359707(181-191)Online publication date: 10-Nov-2019
https://dl.acm.org/doi/10.1145/3343055.3359707
Yamanaka SStuerzlinger WMiyashita HMandryk RHancock MPerry MCox A(2018)Steering through Successive ObjectsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174177(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174177
Xia HHinckley KPahud MTu XBuxton BMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)WritLargeProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025664(3227-3240)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025664
Xia HAraujo BWigdor DMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Collection ObjectsProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025554(5592-5604)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025554
Strothoff SStuerzlinger WHinrichs KNunes NCostanza EOlivier PSchöning J(2015)Pins 'n' TouchesProceedings of the 2015 International Conference on Interactive Tabletops & Surfaces10.1145/2817721.2817731(191-200)Online publication date: 15-Nov-2015
https://dl.acm.org/doi/10.1145/2817721.2817731
Fender AMüller JLindlbauer DBanic ASuma ESteinicke FStuerzlinger W(2015)Creature TeacherProceedings of the 3rd ACM Symposium on Spatial User Interaction10.1145/2788940.2788944(113-122)Online publication date: 8-Aug-2015
https://dl.acm.org/doi/10.1145/2788940.2788944
Lindlbauer DHaller MHancock MScott SStuerzlinger WQuigley AJacucci GHorn MNacenta M(2013)Perceptual groupingProceedings of the 2013 ACM international conference on Interactive tabletops and surfaces10.1145/2512349.2512801(51-60)Online publication date: 6-Oct-2013
https://dl.acm.org/doi/10.1145/2512349.2512801
Xu PFu HAu OTai C(2012)Lazy selectionACM Transactions on Graphics10.1145/2366145.236616131:6(1-9)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1145/2366145.2366161

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten