research-article

Anywhere surface touch: utilizing any surface as an input area

Authors:

Takehiro Niikura,

Yoshihiro Watanabe,

Masatoshi IshikawaAuthors Info & Claims

AH '14: Proceedings of the 5th Augmented Human International Conference

Article No.: 39, Pages 1 - 8

https://doi.org/10.1145/2582051.2582090

Published: 07 March 2014 Publication History

Abstract

The current trend towards smaller and smaller mobile devices may cause considerable difficulties in using them. In this paper, we propose an interface called Anywhere Surface Touch, which allows any flat or curved surface in a real environment to be used as an input area. The interface uses only a single small camera and a contact microphone to recognize several kinds of interaction between the fingers of the user and the surface. The system recognizes which fingers are interacting and in which direction the fingers are moving. Additionally, the fusion of vision and sound allows the system to distinguish the contact conditions between the fingers and the surface. Evaluation experiments showed that users became accustomed to our system quickly, soon being able to perform input operations on various surfaces.

References

[1]

Ahmad, F., and Musilek, P. Ubihand: a wearable input device for 3d interaction. In ACM SIGGRAPH '06 Research posters (2006).

Digital Library

[2]

Amento, B., Hill, W., and Terveen, L. The sound of one hand: A wrist-mounted bio-acoustic fingertip gesture interface. In CHI '02 Extended Abstracts (2002), 724--725.

Digital Library

[3]

Atrey, P., Hossain, M., El Saddik, A., and Kankanhalli, M. Multimodal fusion for multimedia analysis: a survey. Multimedia Systems 16, 6 (2010), 345--379.

Digital Library

[4]

Deyle, T., Palinko, S., Poole, E., and Starner, T. Hambone: A bio-acoustic gesture interface. In Proc. ISWC '07 (2007), 3--10.

Digital Library

[5]

Harrison, C., Benko, H., and Wilson, A. D. Omnitouch: wearable multitouch interaction everywhere. In Proc. UIST '11 (2011), 441--450.

Digital Library

[6]

Harrison, C., and Hudson, S. E. Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces. In Proc. UIST '08 (2008), 205--208.

Digital Library

[7]

Harrison, C., and Hudson, S. E. Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices. In Proc. UIST '09 (2009), 121--124.

Digital Library

[8]

Harrison, C., and Hudson, S. E. Minput: enabling interaction on small mobile devices with high-precision, low-cost, multipoint optical tracking. In Proc. CHI '10 (2010), 1661--1664.

Digital Library

[9]

Harrison, C., Tan, D., and Morris, D. Skinput: appropriating the body as an input surface. In Proc. CHI '10 (2010), 453--462.

Digital Library

[10]

Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., and Olivier, P. Digits: freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proc. UIST '12 (2012), 167--176.

Digital Library

[11]

Mistry, P., and Maes, P. Sixthsense: a wearable gestural interface. In ACM SIGGRAPH ASIA '09 Sketches (2009), 11:1--11:1.

Digital Library

[12]

Nakatsuma, K., and Shinoda, H. Wristband-shaped input interface using user's back of hand. In WHC '11 Demo (2011).

[13]

Nanayakkara, S., Shilkrot, R., Yeo, K. P., and Maes, P. Eyering: A finger worn input device for seamless interactions with our surroundings. In Proc. AH '13 (2013), 13--20.

Digital Library

[14]

Niikura, T., Hirobe, Y., Cassinelli, A., Watanabe, Y., Komuro, T., and Ishikawa, M. In-air typing interface for mobile devices with vibration feedback. In ACM SIGGRAPH '10 Emerging Technologies (2010), 15:1--15:1.

Digital Library

[15]

Roeber, H., Bacus, J., and Tomasi, C. Typing in thin air: the canesta projection keyboard - a new method of interaction with electronic devices. In CHI '03 Extended Abstracts (2003), 712--713.

Digital Library

[16]

Shiratori, T., Park, H. S., Sigal, L., Sheikh, Y., and Hodgins, J. K. Motion capture from body-mounted cameras. ACM Trans. Graph. 30, 4 (2011), 31:1--31:10.

Digital Library

[17]

Villar, N., Izadi, S., Rosenfeld, D., Benko, H., Helmes, J., Westhues, J., Hodges, S., Ofek, E., Butler, A., Cao, X., and Chen, B. Mouse 2.0: multi-touch meets the mouse. In Proc. UIST '09 (2009), 33--42.

Digital Library

[18]

Watanabe, Y., Hatanaka, T., Komuro, T., and Ishikawa, M. Human gait estimation using a wearable camera. In Proc. WACV '11 (2011), 276--281.

Digital Library

[19]

Wilson, A. D. Playanywhere: a compact interactive tabletop projection-vision system. In Proc. UIST '05 (2005), 83--92.

Digital Library

[20]

Yatani, K., and Truong, K. N. Bodyscope: a wearable acoustic sensor for activity recognition. In Proc. UbiComp '12 (2012), 341--350.

Digital Library

Cited By

He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Dupré CAppert CRey SSaidi HPietriga E(2024)TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking OnlyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642323(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642323
Show More Cited By

Index Terms

Anywhere surface touch: utilizing any surface as an input area
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

In this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...
Air+touch: interweaving touch & in-air gestures
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

We present Air+Touch, a new class of interactions that interweave touch events with in-air gestures, offering a unified input modality with expressiveness greater than each input modality alone. We demonstrate how air and touch are highly complementary: ...
3D touch panel interface using an autostereoscopic display
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

We propose a 3D touch panel interface using an autostereoscopic display and a high-speed stereo camera. With this system, the virtual objects are stereoscopically-presented, and the objects respond to the hand movement captured by a stereo camera, which ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AH '14: Proceedings of the 5th Augmented Human International Conference

March 2014

249 pages

ISBN:9781450327619

DOI:10.1145/2582051

General Chair:
Tsutomu Terada
Kobe University, Japan
,
Program Chairs:
Masahiko Inami
Keio University, Japan
,
Kai Kunze
Osaka Prefecture University, Japan
,
Takuya Nojima
University of Electro-communications, Japan

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

MEET IN KOBE 21st Century: MEET IN KOBE 21st Century

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AH '14

Sponsor:

MEET IN KOBE 21st Century

AH '14: 5th Augmented Human International Conference

March 7 - 8, 2014

Kobe, Japan

Acceptance Rates

Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
564
Total Downloads

Downloads (Last 12 months)59
Downloads (Last 6 weeks)9

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Dupré CAppert CRey SSaidi HPietriga E(2024)TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking OnlyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642323(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642323
Shen XYu CWang XLiang CChen HShi Y(2024)MouseRing: Always-available Touchpad Interaction with IMU RingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642225(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642225
Liang CWang XLi ZHsia CFan MYu CShi Y(2023)ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow ProjectionProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606785(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606785
Grady PTang CBrahmbhatt STwigg CWan CHays JKemp C(2022)PressureVision: Estimating Hand Pressure from a Single RGB ImageComputer Vision – ECCV 202210.1007/978-3-031-20068-7_19(328-345)Online publication date: 11-Nov-2022
https://doi.org/10.1007/978-3-031-20068-7_19
Yoshida TOgawa JChoi KBushnaq SNakagaki KIshii HKaltenbrunner MMurer MWolf KOakley I(2021)inDepth: Force-based Interaction with Objects beyond A Physical BarrierProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3442447(1-6)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3442447
Gu YYu CLi ZLi ZWei XShi Y(2020)QwertyRingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34322044:4(1-29)Online publication date: 18-Dec-2020
https://dl.acm.org/doi/10.1145/3432204
Shi YZhang HZhao KCao JSun MNanayakkara S(2020)Ready, Steady, Touch!Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33973094:2(1-25)Online publication date: 15-Jun-2020
https://dl.acm.org/doi/10.1145/3397309
Yeo HLee JBianchi ASamboy AKoike HWoo WQuigley AZhou BCheng JStrohmeier PIshimaru SKosch T(2020)WristLensProceedings of the Augmented Humans International Conference10.1145/3384657.3384797(1-8)Online publication date: 16-Mar-2020
https://dl.acm.org/doi/10.1145/3384657.3384797
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten