research-article

E-Pad: Large Display Pointing in a Continuous Interaction Space around a Mobile Device

Authors:

Laurent GrisoniAuthors Info & Claims

DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference

Pages 1101 - 1108

https://doi.org/10.1145/3322276.3322284

Published: 18 June 2019 Publication History

Abstract

Relative pointing through using tactile mobile device (such as tablets of phones) on a large display is a viable interaction technique (that we call Pad in this paper) which permits accurate pointing. However, limited device size has consequences on interaction. Such systems are known to often require clutching, which degrades performances. We present E-Pad, an indirect relative pointing interaction technique which takes benefit of the mobile tactile surface combined with its surrounding space. A user can perform continuous relative pointing starting on the pad then continuing in the free space around the pad, within arm's reach. As a first step toward E-Pad, we first introduce extended continuous relative pointing gestures and conduct a preliminary study to determine how people move their hand around the mobile device. We then conduct an experiment that compares the performance of E-Pad and Pad. Our findings indicate that E-Pad is faster than Pad and decreases the number of clutches without compromising accuracy. Our findings also suggest an overwhelming preference for E-Pad.

References

[1]

Florent Berthaut, Cagan Arslan, and Laurent Grisoni. 2017. Revgest: Augmenting Gestural Musical Instruments with Revealed Virtual Objects. In NIME '17. Copenhagen, Denmark. https://hal.archives-ouvertes.fr/hal-01518579

[2]

Andrew Bragdon, Rob DeLine, Ken Hinckley, and Meredith Ringel Morris. Code Space: Touch

[3]

Air Gesture Hybrid Interactions for Supporting Developer Meetings. In ITS '11, ACM. ACM, New York, NY, USA, 212--221.

Digital Library

[4]

Géry Casiez and Nicolas Roussel. No More Bricolage!: Methods and Tools to Characterize, Replicate and Compare Pointing Transfer Functions. In UIST '11, ACM. ACM, 603--614.

Digital Library

[5]

Géry Casiez, Daniel Vogel, Qing Pan, and Christophe Chaillou. RubberEdge: Reducing Clutching by Combining Position and Rate Control with Elastic Feedback. In UIST '07, ACM. ACM, 129--138.

Digital Library

[6]

Duncan Cavens, Florian Vogt, Sidney Fels, and Michael Meitner. Interacting with the Big Screen: Pointers to Ponder. In CHI '02, ACM. ACM, 678--679.

Digital Library

[7]

Bruno R. De Araùjo, Géry Casiez, and Joaquim A. Jorge. 2012. Mockup Builder: Direct 3D Modeling on and Above the Surface in a Continuous Interaction Space. In GI '12. Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 173--180. http://dl.acm.org/citation.cfm?id=2305276.2305305

Digital Library

[8]

Herbert D. Jellinek and Stuart K. Card. Powermice and User Performance. In CHI '90, ACM. ACM, New York, NY, USA, 213--220.

Digital Library

[9]

Ricardo Jota, Miguel A. Nacenta, Joaquim A. Jorge, Sheelagh Carpendale, and Saul Greenberg. A Comparison of Ray Pointing Techniques for Very Large Displays. In GI'10, Canadian Information Processing Society. Canadian Information Processing Society, 269--276. http://dl.acm.org/citation.cfm?id=1839214.1839261

Digital Library

[10]

Regis Kopper, Doug A Bowman, Mara G Silva, and Ryan P McMahan. 2010. A human motor behavior model for distal pointing tasks. International journal of human-computer studies 68, 10 (2010), 603--615.

Digital Library

[11]

Mingyu Liu, Mathieu Nancel, and Daniel Vogel. Gunslinger: Subtle Arms-down Mid-air Interaction. In UIST'15, ACM. ACM, 63--71.

Digital Library

[12]

Shahzad Malik, Abhishek Ranjan, and Ravin Balakrishnan. Interacting with Large Displays from a Distance with Vision-tracked Multi-finger Gestural Input. In UIST '05, ACM. ACM, New York, NY, USA, 43--52.

Digital Library

[13]

Nicolai Marquardt, Ricardo Jota, Saul Greenberg, and Joaquim A. Jorge. The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and Above a Digital Surface. In INTERACT'11, Springer. Springer-Verlag, Berlin, Heidelberg, 461--476. http://dl.acm.org/citation.cfm?id=2042182.2042224

[14]

David C. McCallum and Pourang Irani. ARC-Pad: Absolute

[15]

Relative Cursor Positioning for Large Displays with a Mobile Touchscreen. In UIST '09, ACM. ACM, 153--156.

Digital Library

[16]

Brad A. Myers, Rishi Bhatnagar, Jeffrey Nichols, Choon Hong Peck, Dave Kong, Robert Miller, and A. Chris Long. Interacting at a Distance: Measuring the Performance of Laser Pointers and Other Devices. In CHI '02, ACM. ACM, 33--40.

Digital Library

[17]

Mathieu Nancel, Olivier Chapuis, Emmanuel Pietriga, Xing-Dong Yang, Pourang P. Irani, and Michel Beaudouin-Lafon. High-precision Pointing on Large Wall Displays Using Small Handheld Devices. In CHI '13, ACM. ACM, New York, NY, USA, 831--840.

Digital Library

[18]

Mathieu Nancel, Daniel Vogel, and Edward Lank. Clutching Is Not (Necessarily) the Enemy. In CHI'15, ACM. ACM, New York, NY, USA, 4199--4202.

Digital Library

[19]

Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. FingerIO: Using Active Sonar for Fine-Grained Finger Tracking. In CHI '16. ACM, New York, NY, USA, 1515--1525.

Digital Library

[20]

Ji-Young Oh and Wolfgang Stuerzlinger. 2002. Laser Pointers as Collaborative Pointing Devices. (2002).

[21]

Jeffrey S. Pierce, Andrew S. Forsberg, Matthew J. Conway, Seung Hong, Robert C. Zeleznik, and Mark R. Mine. Image Plane Interaction Techniques in 3D Immersive Environments. In I3D, ACM. ACM, 39--ff.

Digital Library

[22]

Krzysztof Pietroszek and Edward Lank. Clicking Blindly: Using Spatial Correspondence to Select Targets in Multi-device Environments. In MobileHCI '12, ACM. ACM, New York, NY, USA, 331--334.

Digital Library

[23]

Hanae Rateau, Yosra Rekik, Laurent Grisoni, and Joaquim Jorge. 2016. Talaria: Continuous Drag & Drop on a Wall Display. In ISS '16. ACM, New York, NY, USA, 199--204.

Digital Library

[24]

Shaishav Siddhpuria, Sylvain Malacria, Mathieu Nancel, and Edward Lank. 2018. Pointing at a Distance with Everyday Smart Devices. In CHI '18. ACM, New York, NY, USA, Article 173, 11 pages.

Digital Library

[25]

Sophie Stellmach and Raimund Dachselt. 2012. Look & Touch: Gaze-supported Target Acquisition. In CHI '12. ACM, New York, NY, USA, 2981--2990.

Digital Library

[26]

Sophie Stellmach and Raimund Dachselt. 2013. Still Looking: Investigating Seamless Gaze-supported Selection, Positioning, and Manipulation of Distant Targets. In CHI '13. ACM, New York, NY, USA, 285--294.

Digital Library

[27]

Kazuki Takashima, Nana Shinshi, and Yoshifumi Kitamura. 2015. Exploring Boundless Scroll by Extending Motor Space. In MobileHCI '15. ACM, New York, NY, USA, 557--566.

Digital Library

[28]

Daniel Vogel and Ravin Balakrishnan. 2005. Distant Freehand Pointing and Clicking on Very Large, High Resolution Displays. In UIST '05. ACM, New York, NY, USA, 33--42.

Digital Library

[29]

Sang Ho Yoon, Ke Huo, and Karthik Ramani. 2016. TMotion: Embedded 3D Mobile Input Using Magnetic Sensing Technique. In TEI '16. ACM, New York, NY, USA, 21--29.

Digital Library

[30]

Yan Zhai, Guoying Zhao, Toni Alatalo, Janne Heikkil"a, Timo Ojala, and Xinyuan Huang. Gesture Interaction for Wall-sized Touchscreen Display. In UbiComp'13, ACM. ACM, 175--178.

Digital Library

Cited By

Belkacem ITominski CMédoc NKnudsen SDachselt RGhoniem M(2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15001
Rateau HRekik YLank E(2023)Ether-Mark: An Off-Screen Marking Menu For Mobile DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614150(224-233)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614150
Kostic ZDumas CPratt SBeyer J(2023)Exploring Mid-Air Hand Interaction in Data VisualizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.333264730:9(6347-6364)Online publication date: 14-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3332647
Show More Cited By

Index Terms

E-Pad: Large Display Pointing in a Continuous Interaction Space around a Mobile Device
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Pointing devices
      2. Touch screens
  2. Ubiquitous and mobile computing
    1. Ubiquitous and mobile devices
      1. Mobile devices

Recommendations

Back-of-device interaction allows creating very small touch devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper, we explore how to add pointing input capabilities to very small screen devices. On first sight, touchscreens seem to allow for particular compactness, because they integrate input and screen into the same physical space. The opposite is ...
Minput: enabling interaction on small mobile devices with high-precision, low-cost, multipoint optical tracking
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present Minput, a sensing and input method that enables intuitive and accurate interaction on very small devices -- ones too small for practical touch screen use and with limited space to accommodate physical buttons. We achieve this by incorporating ...
Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices
UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

We present Abracadabra, a magnetically driven input technique that offers users wireless, unpowered, high fidelity finger input for mobile devices with very small screens. By extending the input area to many times the size of the device's screen, our ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference

June 2019

1628 pages

ISBN:9781450358507

DOI:10.1145/3322276

General Chairs:
Steve Harrison
Virginia Tech, USA
,
Shaowen Bardzell
Indiana University, USA
,
Program Chairs:
Carman Neustaedter
Simon Fraser University, Canada
,
Deborah Tatar
Virginia Tech, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

DIS '19

Sponsor:

SIGCHI

DIS '19: Designing Interactive Systems Conference 2019

June 23 - 28, 2019

CA, San Diego, USA

Acceptance Rates

DIS '19 Paper Acceptance Rate 105 of 415 submissions, 25%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
223
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)1

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Belkacem ITominski CMédoc NKnudsen SDachselt RGhoniem M(2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15001
Rateau HRekik YLank E(2023)Ether-Mark: An Off-Screen Marking Menu For Mobile DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614150(224-233)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614150
Kostic ZDumas CPratt SBeyer J(2023)Exploring Mid-Air Hand Interaction in Data VisualizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.333264730:9(6347-6364)Online publication date: 14-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3332647
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Brasier EChapuis OFerey NVezien JAppert C(2020)ARPads: Mid-air Indirect Input for Augmented Reality2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR50242.2020.00060(332-343)Online publication date: Nov-2020
https://doi.org/10.1109/ISMAR50242.2020.00060

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents