research-article

HoverFlow: expanding the design space of around-device interaction

Authors:

Michael RohsAuthors Info & Claims

MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 4, Pages 1 - 8

https://doi.org/10.1145/1613858.1613864

Published: 15 September 2009 Publication History

Abstract

In this paper we explore the design space of around-device interaction (ADI). This approach seeks to expand the interaction possibilities of mobile and wearable devices beyond the confines of the physical device itself to include the space around it. This enables rich 3D input, comprising coarse movement-based gestures, as well as static position-based gestures. ADI can help to solve occlusion problems and scales down to very small devices. We present a novel around-device interaction interface that allows mobile devices to track coarse hand gestures performed above the device's screen. Our prototype uses infrared proximity sensors to track hand and finger positions in the device's proximity. We present an algorithm for detecting hand gestures and provide a rough overview of the design space of ADI-based interfaces.

References

[1]

Arduino: prototyping boards and development environment, http://www.arduino.cc.

[2]

Baudisch, P. and Chu, G. 2009. Back-of-device interaction allows creating very small touch devices. In Proc. of CHI '09.

Digital Library

[3]

Breuer, P. and Eckes, C. and Muller, S., Hand Gesture Recognition with a Novel IR Time-of-Flight Range Camera-A Pilot Study, Lecture Notes in Computer Science, Vol. 4418, pp. 247, Springer, 2007.

Digital Library

[4]

Butler, A., Izadi, S., and Hodges, S. 2008. SideSight: Multi-"touch" interaction around small devices. In Proc. of UIST'08. ACM, 201--204.

Digital Library

[5]

Buxton, W. A. 1995. Chunking and phrasing and the design of human-computer dialogues. In Human-Computer interaction: Toward the Year 2000, R. M. Baecker, J. Grudin, W. A. Buxton, and S. Greenberg, Eds. Morgan Kaufmann Publishers, San Francisco, CA, 494--499.

Digital Library

[6]

Franco, I. 2004. The AirStick: A free-gesture controller using infrared sensing. In Proc. New Interfaces For Musical Expression (NIME), 248--249.

Digital Library

[7]

Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. 2000. Sensing techniques for mobile interaction. In Proc. of UIST'00. ACM, 91--100.

Digital Library

[8]

Hodges, S., Izadi, S., Butler, A., Rrustemi, A., and Buxton, B. 2007. ThinSight: Versatile multi-touch sensing for thin form-factor displays. In Proc. of UIST '07. ACM, New York, NY, 259--268.

Digital Library

[9]

Howard, B. and Howard, M. G.: Ubiquitous Computing Enabled by Optical Reflectance Controller. Whitepaper. Lightglove, Inc., http://lightglove.com/White%20Paper.htm. (Visited on 25.06.2009).

[10]

Izadi, S., Hodges, S., Butler, A., Rrustemi, A., and Buxton, B. 2007. ThinSight: Integrated optical multi-touch sensing through thin form-factor displays. In Proc. of the 2007 Workshop on Emerging Displays Technologies: Images and Beyond: the Future of Displays and interacton. EDT '07, vol. 252. ACM, 6--9.

Digital Library

[11]

Izadi, S., Butler, A., Hodges, S., West, D., Hall, M., Buxton, B., Molloy, M. Experiences with Building a Thin Form-factor Touch and Tangible Tabletop. Proc. of TABLETOP 2008, 193--196.

[12]

Kruskall, J.&M. Liberman. The Symmetric Time Warping Problem: From Continuous to Discrete. In Time Warps, String Edits and Macromolecules: The Theory and Practice of Sequence Comparison, pp. 125--161, Addison-Wesley Publishing Co., Reading, Massachusetts, 1983.

[13]

Metzger, C., Anderson, M., and Starner, T. 2004. FreeDigiter: A Contact-Free Device for Gesture Control. In Proc. of the Eighth international Symposium on Wearable Computers. ISWC. IEEE Computer Society, 18--21.

Digital Library

[14]

Sadun, E., iPhone Developer's Cookbook, Pearson Education, November 28, 2008, ISBN 0321555457.

[15]

Salvador, S. and Chan, P., FastDTW: Toward Accurate Dynamic Time Warping in Linear Time and Space, KDD Workshop on Mining Temporal and Sequential Data, 70--80, 2004.

[16]

Savitzky, A., Golay, M. J. E. 1964. Smoothing and Differentiation of Data by Simplified Least Squares Procedures. Analytical Chemistry, 36 (8), 1627--1639.

[17]

Sharp GP2D120 Distance Sensor, http://www.sharpsma.com/Page.aspx/americas/en/part/GP2D120/

[18]

Sharp 2Y2A001 wide-angle IR distance sensor, http://sharp-world.com/products/device/lineup/data/pdf/datasheet/gp2y3a001k_e.pdf

[19]

Smith, J., White, T., Dodge, C., Paradiso, J., Gershenfeld, N., and Allport, D. 1998. Electric Field Sensing For Graphical Interfaces. IEEE Comput. Graph. Appl. 18, 3 (May. 1998), 54--60.

Digital Library

[20]

SwissRanger 4000 Time-of-Flight Camera, Mesa Imaging AG, http://www.mesa-imaging.ch/dlm.php?fname=pdf/SR4000_Data_Sheet_revl.5.pdf

[21]

Starner, T. and Auxier, J. and Ashbrook, D. and Gandy, M, The gesture pendant: A self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring, International Symposium on Wearable Computing, 2000, pp. 87--94.

Digital Library

[22]

Theremin, L. S. 1996. The Design of a Musical Instrument Based on Cathode Relays. Reprinted in Leonardo Music J., No. 6, 1996, 49--50.

[23]

Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. 2007. Lucid touch: A see-through mobile device. In Proc. of UIST '07. ACM, 269--278.

Digital Library

[24]

Zhen Wang, Lin Zhong, Jehan Wickramasuriya, and Venu Vasudevan, uWave: Accelerometer-based personalized gesture recognition, Technical Report, Rice University and Motorola Labs, June 2008.

Cited By

Courtoux EAppert CChapuis O(2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580877
Sun ZWang SLiu CMa X(2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3511892
Langner RSatkowski MBüschel WDachselt RKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data AnalysisProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445593(1-17)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445593
Show More Cited By

Index Terms

HoverFlow: expanding the design space of around-device interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Recommendations

Hoverflow: exploring around-device interaction with IR distance sensors
MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

By equipping a mobile device with distance sensing capabilities, we aim to expand the interaction possibilities of mobile and wearable devices beyond the confines of the physical device itself to include the space immediately around it. Our prototype, ...
Thumbs-Up: 3D Spatial Thumb-Reachable Space for One-Handed Thumb Interaction on Smartphones
SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

People very often use mobile devices with one hand to free the second hand for other tasks. In such cases, the thumb of the hand holding the device is the only available input finger, making multi-touch interactions impossible. Complicating interaction ...
Sensor synaesthesia: touch in motion, and motion in touch
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We explore techniques for hand-held devices that leverage the multimodal combination of touch and motion. Hybrid touch + motion gestures exhibit interaction properties that combine the strengths of multi-touch with those of motion-sensing. This affords ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 2009

473 pages

ISBN:9781605582818

DOI:10.1145/1613858

Conference Chair:
Reinhard Oppermann
Fraunhofer FIT
,
Program Chairs:
Markus Eisenhauer
Fraunhofer FIT
,
Matthias Jarke
RWTH Aachen + Fraunhofer FIT
,
Volker Wulf
University of Siegen + Fraunhofer FIT

Copyright © 2009 Copyright is held by the author/owner(s).

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '09

MobileHCI '09: 11th International Conference on Human Computer Interaction with Mobile Devices and Services

September 15 - 18, 2009

Bonn, Germany

Acceptance Rates

MobileHCI '09 Paper Acceptance Rate 23 of 95 submissions, 24%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

95
Total Citations
View Citations
1,511
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)2

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Courtoux EAppert CChapuis O(2023)SurfAirs: Surface + Mid-air Input for Large Vertical DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580877(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580877
Sun ZWang SLiu CMa X(2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3511892
Langner RSatkowski MBüschel WDachselt RKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data AnalysisProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445593(1-17)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445593
Buruk OIsbister KTanenbaum TDeterding SKhosmood FPirker JApperley T(2019)A design framework for playful wearablesProceedings of the 14th International Conference on the Foundations of Digital Games10.1145/3337722.3337733(1-12)Online publication date: 26-Aug-2019
https://dl.acm.org/doi/10.1145/3337722.3337733
Xiao CBayer KZheng CNayar S(2019)VidgetsACM Transactions on Graphics10.1145/3306346.332294338:4(1-12)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3322943
Yan XMadier KPark SNewman MHarrison SBardzell SNeustaedter CTatar D(2019)Towards Low-burden In-situ Self-reportingCompanion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion10.1145/3301019.3323905(337-346)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3301019.3323905
Yu CWei XVachher SQin YLiang CWeng YGu YShi YBrewster SFitzpatrick GCox AKostakos V(2019)HandSeeProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300935(1-13)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300935
Laput GHarrison CBrewster SFitzpatrick GCox AKostakos V(2019)SurfaceSightProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300559(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300559
Liu CWu NMao HSu W(2019)Smart-Scrolling: Improving Information Access Performance in Linear Layout Views for Small-Screen DevicesIntelligent Computing Theories and Application10.1007/978-3-030-26763-6_40(412-423)Online publication date: 24-Jul-2019
https://doi.org/10.1007/978-3-030-26763-6_40
Turner CChaparro BHe J(2018)Texting while walkingJournal of Usability Studies10.5555/3294038.329404213:2(94-118)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.5555/3294038.3294042
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents