research-article

Hover Pad: interacting with autonomous and self-actuated displays in space

Authors:

Julian Seifert,

Sebastian Boring,

Christian Winkler,

Florian Schaub,

Steffen Herrdum,

Enrico RukzioAuthors Info & Claims

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

Pages 139 - 147

https://doi.org/10.1145/2642918.2647385

Published: 05 October 2014 Publication History

Abstract

Handheld displays enable flexible spatial exploration of information spaces -- users can physically navigate through three-dimensional space to access information at specific locations. Having users constantly hold the display, however, has several limitations: (1) inaccuracies due to natural hand tremors; (2) fatigue over time; and (3) limited exploration within arm's reach. We investigate autonomous, self-actuated displays that can freely move and hold their position and orientation in space without users having to hold them at all times. We illustrate various stages of such a display's autonomy ranging from manual to fully autonomous, which -- depending on the tasks -- facilitate the interaction. Further, we discuss possible motion control mechanisms for these displays and present several interaction techniques enabled by such displays. Our Hover Pad toolkit enables exploring five degrees of freedom of self-actuated and autonomous displays and the developed control and interaction techniques. We illustrate the utility of our toolkit with five prototype applications, such as a volumetric medical data explorer.

Supplementary Material

suppl.mov (uistf2987-file3.mp4)

Supplemental video

Download
50.12 MB

References

[1]

Alrøe, T., Grann, J., Gronvall, E., Petersen, M. G., and Rasmussen, J. L. Aerial tunes: exploring interaction qualities of mid-air displays. In NordiCHI '12, ACM (2012).

Digital Library

[2]

Baur, D., Boring, S., and Feiner, S. Virtual projection: exploring optical projection as a metaphor for multi-device interaction. In CHI '12, ACM (2012).

Digital Library

[3]

Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. Toolglass and magic lenses: the see-through interface. In SIGGRAPH '93, ACM (1993).

Digital Library

[4]

Boring, S., Baur, D., Butz, A., Gustafson, S., and Baudisch, P. Touch projector: mobile interaction through video. In CHI '10, ACM (2010).

Digital Library

[5]

Breazeal, C., Wang, A., and Picard, R. Experiments with a robotic computer: Body, affect and cognition interactions. In HRI '07, ACM (2007), 153--160.

Digital Library

[6]

Chen, X. A., Marquardt, N., Tang, A., Boring, S., and Greenberg, S. Extending a mobile device's interaction space through body-centric interaction. In MobileHCI '12, ACM (2012).

Digital Library

[7]

fitzmaurice, G. W. Situated information spaces and spatially aware palmtop computers. Commun. ACM 36, 7 (July 1993).

Digital Library

[8]

fitzmaurice, G. W. Graspable User Interfaces. PhD thesis, Graduate Dept. of Computer Science, University of Toronto, 1996.

Digital Library

[9]

Hashimoto, S., Suzuki, R., Kamiyama, Y., Inami, M., and Igarashi, T. World locomotion. http://s-hashimoto.org/?page_id=73&lang=en, 2013. (Last access: 2014/06/30).

[10]

Hortner, H., Gardiner, M., Haring, R., Lindinger, C., and Berger, F. Spaxels, pixels in space. http://www.aec.at/futurelab/files/2012/07/ spaxels_revision_final_20120615.pdf. (Last access: 2014/04/16).

[11]

Izadi, S., Hodges, S., Taylor, S., Rosenfeld, D., Villar, N., Butler, A., and Westhues, J. Going beyond the display: a surface technology with an electronically switchable diffuser. In UIST '08, ACM (2008).

Digital Library

[12]

Konieczny, J., Shimizu, C., Meyer, G., and Colucci, D. A handheld flexible display system. In Visualization, 2005. VIS 05. IEEE (2005).

[13]

Lee, J., Post, R., and Ishii, H. ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation. In UIST '11, ACM (2011).

Digital Library

[14]

Marquardt, N., Jota, R., Greenberg, S., and Jorge, J. A. The continuous interaction space: interaction techniques unifying touch and gesture on and above a digital surface. In INTERACT'11 (2011).

Digital Library

[15]

Marshall, M., Carter, T., Alexander, J., and Subramanian, S. Ultra-tangibles: creating movable tangible objects on interactive tables. In CHI '12, ACM (2012).

Digital Library

[16]

Nowacka, D., Ladha, K., Hammerla, N. Y., Jackson, D., Ladha, C., Rukzio, E., and Olivier, P. Touchbugs: actuated tangibles on multi-touch tables. In CHI '13, ACM (2013).

Digital Library

[17]

Pangaro, G., Maynes-Aminzade, D., and Ishii, H. The actuated workbench: computer-controlled actuation in tabletop tangible interfaces. In UIST '02, ACM (2002).

Digital Library

[18]

Patten, J., and Ishii, H. Mechanical constraints as computational constraints in tabletop tangible interfaces. In CHI '07, ACM (2007).

Digital Library

[19]

Pedersen, E. W., and Hornbaek, K. Tangible bots: interaction with active tangibles in tabletop interfaces. In CHI '11, ACM (2011).

Digital Library

[20]

Rosenfeld, D., Zawadzki, M., Sudol, J., and Perlin, K. Physical objects as bidirectional user interface elements. Computer Graphics and Applications (2004).

Digital Library

[21]

Schmidt, D., Seifert, J., Rukzio, E., and Gellersen, H. A cross-device interaction style for mobiles and surfaces. In DIS '12, ACM (2012).

Digital Library

[22]

Schneegaß, S., Alt, F., Scheible, J., Schmidt, A., and Su, H. Midair displays: Exploring the concept of free-floating public displays. In CHI '14 Extended Abstracts (2014).

Digital Library

[23]

Sinclair, M., Pahud, M., and Benko, H. TouchMover: Actuated 3D Touchscreen with Haptic Feedback. In ITS '13, ACM (2013).

Digital Library

[24]

Spindler, M., Büschel, W., and Dachselt, R. Use your head: tangible windows for 3D information spaces in a tabletop environment. In ITS '12, ACM (2012).

Digital Library

[25]

Spindler, M., Martsch, M., and Dachselt, R. Going beyond the surface: studying multi-layer interaction above the tabletop. In CHI '12, ACM (2012).

Digital Library

[26]

Spindler, M., Tominski, C., Schumann, H., and Dachselt, R. Tangible views for information visualization. In ITS '10, ACM (2010).

Digital Library

[27]

Steimle, J., Jordt, A., and Maes, P. Flexpad: highly flexible bending interactions for projected handheld displays. In CHI '13, ACM (2013).

Digital Library

[28]

Tsang, M., fitzmaurice, G. W., Kurtenbach, G., Khan, A., and Buxton, B. Boom chameleon: simultaneous capture of 3d viewpoint, voice and gesture annotations on a spatially-aware display. In UIST '02, ACM (2002).

Digital Library

[29]

Ullmer, B., and Ishii, H. The metadesk: Models and prototypes for tangible user interfaces. In UIST '97, ACM (1997), 223--232.

Digital Library

[30]

Weiss, M., Remy, C., and Borchers, J. Rendering physical effects in tabletop controls. In CHI '11, ACM (2011).

Digital Library

[31]

Weiss, M., Schwarz, F., Jakubowski, S., and Borchers, J. Madgets: actuating widgets on interactive tabletops. In UIST '10, ACM (2010).

Digital Library

[32]

Wilson, A., Benko, H., Izadi, S., and Hilliges, O. Steerable augmented reality with the beamatron. In UIST '12, ACM (2012).

Digital Library

[33]

Yee, K.-P. Peephole displays: pen interaction on spatially aware handheld computers. In CHI '03, ACM (2003).

Digital Library

Cited By

Ando SKoizumi N(2024)An Optical Design for Interaction With Mid-Air Images Using the Shape of Real ObjectsIEEE Access10.1109/ACCESS.2024.337478212(39129-39138)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3374782
Suzuki RKarim AXia THedayati HMarquardt N(2022)Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517719(1-33)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517719
Marquardt NHenry Riche NHolz CRomat HPahud MBrudy FLedo DPark CNicholas MSeyed TOfek ELee BBuxton WHinckley K(2021)AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware ArmaturesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474820(1252-1268)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474820
Show More Cited By

Index Terms

Hover Pad: interacting with autonomous and self-actuated displays in space
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

MK-pad: a Mouse+Keyboard input technique for distance interaction through a mobile tablet device
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction

We introduce MK-Pad (Mouse+Keyboard Pad), a technique for entering text and performing mouse operations using a tablet device for distance interaction. MK-Pad uses the screen of a 10.1" tablet touchscreen to host a soft keyboard and turns the screen ...
Hover Cursor: Improving Touchscreen Acquisition Of Small Targets With Hover-enabled Pre-selection
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

Even with highly-sensitive touchscreens and emphasis on "designing for touch", small target selection remains difficult. Good touch performance cannot solve the "fat-finger" problem, which results from occlusion and the size disparity between fingers ...
A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Proximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

October 2014

722 pages

ISBN:9781450330695

DOI:10.1145/2642918

General Chair:
Hrvoje Benko
Microsoft Research, USA
,
Program Chairs:
Mira Dontcheva
Adobe, USA
,
Daniel Wigdor
University of Toronto, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '14

Sponsor:

UIST '14: The 27th Annual ACM Symposium on User Interface Software and Technology

October 5 - 8, 2014

Hawaii, Honolulu, USA

Acceptance Rates

UIST '14 Paper Acceptance Rate 74 of 333 submissions, 22%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
770
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ando SKoizumi N(2024)An Optical Design for Interaction With Mid-Air Images Using the Shape of Real ObjectsIEEE Access10.1109/ACCESS.2024.337478212(39129-39138)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3374782
Suzuki RKarim AXia THedayati HMarquardt N(2022)Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517719(1-33)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517719
Marquardt NHenry Riche NHolz CRomat HPahud MBrudy FLedo DPark CNicholas MSeyed TOfek ELee BBuxton WHinckley K(2021)AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware ArmaturesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474820(1252-1268)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474820
Li RHuang TLiang HHan BZhang XLiao H(2021)3D Volume Visualization and Screen-based Interaction with Dynamic Ray Casting on Autostereoscopic Display2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct54149.2021.00056(240-245)Online publication date: Oct-2021
https://doi.org/10.1109/ISMAR-Adjunct54149.2021.00056
Romat HCollins CHenry Riche NPahud MHolz CRiddle ABuxton BHinckley KIqbal SMacLean KChevalier FMueller S(2020)Tilt-Responsive Techniques for Digital Drawing BoardsProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415861(500-515)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415861
Plasson CCunin DLaurillau YNigay LLee BLee GScott STory MKim J(2019)Tabletop AR with HMD and TabletProceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces10.1145/3343055.3360760(409-414)Online publication date: 10-Nov-2019
https://dl.acm.org/doi/10.1145/3343055.3360760
Kudo YTakashima KFjeld MKitamura YKoike HRatti CTakeuchi YFukuchi KScott SPlasencia D(2018)AdapTableProceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces10.1145/3279778.3279779(213-225)Online publication date: 19-Nov-2018
https://dl.acm.org/doi/10.1145/3279778.3279779
Teyssier MBailly GPelachaud CLecolinet EBaudisch PSchmidt AWilson A(2018)MobiLimbProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242626(53-63)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242626
Tiab JBoring SStrohmeier PMarkussen AAlexander JHornbæk KCatarci TNorman KMecella M(2018)TiltstacksProceedings of the 2018 International Conference on Advanced Visual Interfaces10.1145/3206505.3206530(1-5)Online publication date: 29-May-2018
https://dl.acm.org/doi/10.1145/3206505.3206530
Siu AGonzalez EYuan SGinsberg JFollmer SMandryk RHancock MPerry MCox A(2018)shapeShiftProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173865(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173865
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents