research-article

Talaria: Continuous Drag & Drop on a Wall Display

Authors:

Laurent Grisoni,

Joaquim JorgeAuthors Info & Claims

ISS '16: Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces

Pages 199 - 204

https://doi.org/10.1145/2992154.2992164

Published: 06 November 2016 Publication History

Abstract

We present an interaction technique combining tactile actions and midair pointing to access out-of-reach content on large displays without the need to walk across the display. Users can start through a touch gesture on the display surface and finish midair by pointing to push content away or inversely to retrieve a content. The technique takes advantage of well-known semantics of pointing in human-to-human interaction. These, coupled with the semantics of proximal relations and deictic proxemics make the proposed technique very powerful as it leverages on well-understood human-human interaction modalities. Experimental results show this technique to outperform direct tactile interaction on dragging tasks. From our experience we derive four guidelines for interaction with large-scale displays.

Supplementary Material

suppl.mov (iss0130-file3.mp4)

Supplemental video

Download
40.00 MB

References

[1]

Ballendat, T., Marquardt, N., and Greenberg, S. Proxemic interaction: Designing for a proximity and orientation-aware environment. In Proc. of ITS (2010).

Digital Library

[2]

Banerjee, A., Burstyn, J., Girouard, A., and Vertegaal, R. Pointable: An in-air pointing technique to manipulate out-of-reach targets on tabletops. In Proc. of ITS (2011).

Digital Library

[3]

Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P., Bederson, B., Zierlinger, A., et al. Drag-and-pop and drag-and-pick: Techniques for accessing remote screen content on touch-and pen-operated systems. In Proc. of INTERACT (2003).

[4]

Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. Toolglass and magic lenses: The see-through interface. In Proc. of SIGGRAPH (1993).

Digital Library

[5]

Chen, X. A., Schwarz, J., Harrison, C., Mankoff, J., and Hudson, S. E. Air+touch: Interweaving touch & in-air gestures. In Proc. of UIST (2014).

Digital Library

[6]

Collomb, M., Hascoét, M., Baudisch, P., and Lee, B. Improving drag-and-drop on wall-size displays. In Proc. of GI (2005).

Digital Library

[7]

De Araújo, B., Casiez, G., Jorge, J., and Hachet, M. Mockup Builder: 3D Modeling On and Above the Surface. Computers & Graphics (2013).

[8]

Ekman, P., and Friesen, W. V. The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica (1969).

[9]

Forlines, C., Vogel, D., and Balakrishnan, R. Hybridpointing: Fluid switching between absolute and relative pointing with a direct input device. In Proc. of UIST (2006).

Digital Library

[10]

Gilliot, J., Casiez, G., and Roussel, N. Direct and Indirect Multi-Touch Interaction on a Wall Display. In Proc. of IHM (2014).

Digital Library

[11]

Hall, E. T. The hidden dimension . Doubleday & Co, 1966.

[12]

Hascoët, M. Throwing Models for Large Displays. In Proc. of HCI (2003).

[13]

Jota, R., Lopes, P., Wigdor, D., and Jorge, J. Let's kick it: How to stop wasting the bottom third of your large screen display. In Proc. of CHI (2014).

Digital Library

[14]

Liu, M., Nancel, M., and Vogel, D. Gunslinger: Subtle arms-down mid-air interaction. In Proc. of UIST (2015).

Digital Library

[15]

Marquardt, N., Jota, R., Greenberg, S., and Jorge, J. A. The continuous interaction space: Interaction techniques unifying touch and gesture on and above a digital surface. In Proc. of INTERACT (2011).

Digital Library

[16]

Nancel, M., Chapuis, O., Pietriga, E., Yang, X.-D., Irani, P. P., and Beaudouin-Lafon, M. High-precision pointing on large wall displays using small handheld devices. In Proc. of CHI (2013).

Digital Library

[17]

Parker, J. K., Mandryk, R. L., and Inkpen, K. M. Integrating point and touch for interaction with digital tabletop displays. Proc. of CGA (2006).

Digital Library

[18]

Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., et al. It's mine, don't touch!: Interactions at a large multi-touch display in a city centre. In Proc. of CHI (2008).

Digital Library

[19]

Reetz, A., Gutwin, C., Stach, T., Nacenta, M., and Subramanian, S. Superflick: A natural and efficient technique for long-distance object placement on digital tables. In Proc. of GI (2006).

Digital Library

[20]

Rogers, Y., and Lindley, S. Collaborating around vertical and horizontal large interactive displays: which way is best? Interacting with Computers (2004).

[21]

Schmidt, C., Müller, J., and Bailly, G. Screenfinity: extending the perception area of content on very large public displays. In Proc. of CHI (2013).

Digital Library

[22]

Weibel, N., Piper, A. M., and Hollan, J. D. Hiperpaper: Introducing pen and paper interfaces for ultra-scale wall displays. In Proc. of UIST (2010).

Digital Library

[23]

Zhai, Y., Zhao, G., Alatalo, T., Heikkilä, J., Ojala, T., and Huang, X. Gesture interaction for wall-sized touchscreen display. In Proc. of UbiComp (2013).

Digital Library

Cited By

Belkacem ITominski CMédoc NKnudsen SDachselt RGhoniem M(2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15001
Huang CChen YTong WFeng TDeng M(2023)Research on Human-Computer Interaction Technology of Large-Scale High-Resolution Display Wall SystemApplied Sciences10.3390/app1301059113:1(591)Online publication date: 1-Jan-2023
https://doi.org/10.3390/app13010591
Courtoux EAppert CChapuis O(2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580877
Show More Cited By

Index Terms

Talaria: Continuous Drag & Drop on a Wall Display
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Proximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...
Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Zooming user interfaces are increasingly popular on mobile devices with touch screens. Swiping and pinching finger gestures anywhere on the screen manipulate the displayed portion of a page, and taps open objects within the page. This makes navigation ...
3-D interaction with a large wall display using transparent markers
AVI '10: Proceedings of the International Conference on Advanced Visual Interfaces

In this paper we proposed a new interface for interacting with large displays via small video devices such as a cell phone. We estimate the location of the camera relative to the display using a matrix of transparent markers embedded on display. As a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ISS '16: Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces

November 2016

554 pages

ISBN:9781450342483

DOI:10.1145/2992154

General Chairs:
Mark Hancock
University of Waterloo, Canada
,
Nicolai Marquardt
University College London, UK
,
Program Chairs:
Johannes Schöning
Hasselt University, Belgium
,
Melanie Tory
Tableau Research, USA

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ISS '16

Sponsor:

SIGCHI

ISS '16: 2016 ACM International Conference on Interactive Surfaces and Spaces

November 6 - 9, 2016

Ontario, Niagara Falls, Canada

Acceptance Rates

ISS '16 Paper Acceptance Rate 33 of 119 submissions, 28%;

Overall Acceptance Rate 147 of 533 submissions, 28%

Upcoming Conference

ISS '24

Sponsor:
sigchi

Conference on Interactive Surfaces and Spaces

October 27 - 30, 2024

Vancouver , BC , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
204
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Belkacem ITominski CMédoc NKnudsen SDachselt RGhoniem M(2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15001
Huang CChen YTong WFeng TDeng M(2023)Research on Human-Computer Interaction Technology of Large-Scale High-Resolution Display Wall SystemApplied Sciences10.3390/app1301059113:1(591)Online publication date: 1-Jan-2023
https://doi.org/10.3390/app13010591
Courtoux EAppert CChapuis O(2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580877
Li DGe XMa QMehra BLiu JHan TLiu C(2022)Evaluating Three Touch Gestures for Moving Objects across Folded ScreensProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503096:3(1-28)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550309
Dickson TWehbe RMatulic FVogel D(2021)HybridPointing for TouchProceedings of the ACM on Human-Computer Interaction10.1145/34885405:ISS(1-22)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488540
Kuramochi AKomuro T(2021)3D Hand Pointing Recognition over a Wide Area using Two Fisheye CamerasHCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence10.1007/978-3-030-90963-5_5(58-67)Online publication date: 11-Nov-2021
https://doi.org/10.1007/978-3-030-90963-5_5
Arslan CRekik YGrisoni LHarrison SBardzell SNeustaedter CTatar D(2019)E-PadProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322284(1101-1108)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322284

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents