research-article

Clip-on gadgets: expanding multi-touch interaction area with unpowered tactile controls

Authors:

Sung-Sheng Tsai,

Yi-Ping HungAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

Pages 367 - 372

https://doi.org/10.1145/2047196.2047243

Published: 16 October 2011 Publication History

Abstract

Virtual keyboards and controls, commonly used on mobile multi-touch devices, occlude content of interest and do not provide tactile feedback. Clip-on Gadgets solve these issues by extending the interaction area of multi-touch devices with physical controllers. Clip-on Gadgets use only conductive materials to map user input on the controllers to touch points on the edges of screens; therefore, they are battery-free, lightweight, and low-cost. In addition, they can be used in combination with multi-touch gestures. We present several hardware designs and a software toolkit, which enable users to simply attach Clip-on Gadgets to an edge of a device and start interacting with it.

Supplementary Material

JPG File (fp327.jpg)

Download
10.81 KB

MP4 File (fp327.mp4)

Download
21.91 MB

References

[1]

Baudisch, P. and Chu, G. Back-of-device interaction allows creating very small touch devices. In Proc. CHI 2009. 1923--193.

Digital Library

[2]

Block, F., Haller, M., Gellersen, H., Gutwin, C., and Billinghurst, M. VoodooSketch -- extending interactive surfaces with adaptable interface palettes. In Proc. of TEI 2008, 55--58.

Digital Library

[3]

Brewster, S. and Chohan, F., and Brown, L. Tactile Feedback for Mobile Interactions, Ext. Abstracts CHI 2007, 159--162.

Digital Library

[4]

Fukumoto, M. and Sugimura, T. Active Click: Tactile Feedback for Touch Panels, Ext. Abstracts CHI 2001, 121--122.

Digital Library

[5]

Gohlke, K., Hlatky, M., Helse, S. and Loviscach, J. FlexiKnobs: bridging the gap between mouse interaction and hardware controllers. In Proc. TEI 2010, 241 -- 24.

Digital Library

[6]

Hermitage Nouso: Tactile+Plus.

[7]

http://game.watch.impress.co.jp/docs/series/ggl/20101102_404249.html.

[8]

Hiraoka, S., Miyamoto, I. and Tomimatsu, K. Behind Touch, a Text Input Method for Mobile Phones by The Back and Tactile Sense Interface. Information Processing Society of Japan, Interaction 2003,131--138.

[9]

Karlson, A., Bederson, B., Contreras-Vidal, J. (2006) Understanding Single-Handed Mobile Device Interaction. Tech Report HCIL-2006-02, Computer Science Dept., University of Marylan.

[10]

Klemmer, R.S., Li, J., Lin, J., and Landay J.A. Papier-Mache: toolkit support for tangible input. In Proc. CHI 2004, 399--40.

Digital Library

[11]

Koskinen, E., Kaaresoja, T. and Laitinen, P. Feel-good touch: finding the most pleasant tactile feedback for a mobile touch screen button. In Proc. ICMI 2008.

Digital Library

[12]

1Li, K., Baudisch, P. and Hinckley, K. BlindSight: eyes-free access to mobile phones. In Proc. CHI 2008, 1389--1398.

Digital Library

[13]

MacKenzie, I.S., Soukoreff, R.W. Text entry for mobile computing: Models and methods, theory and practice. Human-Computer Interaction 17 (2). Lawrence Erlbaum, 2002, 147--19.

[14]

Mangen, A. and Velay J.L. Digitizing Literacy: Reflections on the Haptics of Writing. In Journal of Advances in Haptics (2010), 385--401.

[15]

Nashel, A. and Razzaque, S. Tactile Virtual Buttons for Mobile Devices, Ext. Abstracts CHI 2003, 854--855.

Digital Library

[16]

Potter, R., Weldon, L. and Shneiderman, B. Improving the accuracy of touch screens: an experimental evaluation of three strategies. In Proc. CHI 1988, 27--32.

Digital Library

[17]

Poupyrev, I. Maruyama, S. and Rekimoto, J. Ambient touch: designing tactile interfaces for handheld devices. In Proc. UIST 2002, 51--6.

Digital Library

[18]

Rekimoto, J. Ullmer, B. and Oba, H. DataTiles: a modular platform for mixed physical and graphical interactions. In Proc. of CHI 2001, 269--276.

Digital Library

[19]

Senseg E-Sense® solution.

[20]

http:// http://senseg.com/.

[21]

Siek, K.A., Rogers, Y. and Connelly, K.H. Fat Finger Worries: How Older and Younger Users Physically Interact with PDAs. In Proc. INTERACT 2005, 267--280.

Digital Library

[22]

Sugimoto, M. and Hiroki, K. HybridTouch: an intuitive manipulation technique for PDAs using their front and rear surfaces. In Proc. MobileHCI 2006, 137--140.

Digital Library

[23]

Sun, X., Plocher, T. and Qu, W. An Empirical Study on the Smallest Comfortable Button/Icon Size on Touch Screen. Usability and Internationalization, Part I, HCII 2007, LNCS 4559, 615--621, 200.

Digital Library

[24]

Ten One Design: Fling analog joystick. http://tenonedesign.com/flin.

[25]

Vogel, D. and Baudisch, P. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proc. CHI 2007, 657--666.

Digital Library

[26]

Weiss, M., Wagner, J., Jennings, R., Jansen, Y., Khoshabeh, R., Hollan, D.J. and Borchers, J. SLAP widgets: bridging the gap between virtual and physical controls on tabletops. In Proc. of CHI 2009, 3229--3234.

Digital Library

[27]

Wobbrock, J.O., Myers, B.A. and Aung, H.H. The performance of hand postures in front- and back-of-device interaction for mobile computing. International Journal of Human-Computer Studies 2008, 857--875.

Digital Library

[28]

Yu, N.H., Chan, L.W., Lau, S.Y., Tsai, S.S., Hsiao, I.C., Tsai, D.J., Cheng, L.P., Hsiao, F.I., Chen, M.Y., Huang, P. and Hung, Y.P. TUIC: Enabling Tangible Interaction on Capacitive Multi-touch Display. To appear in Proc. CHI 201.

Digital Library

[29]

Zimmerman, D.T., Smith, R.J., Paradiso, A.J., Allport, D. and Gershenfeld, N. Applying electric field sensing to human-computer interfaces. In Proc. of CHI 1995, 280--287.

Digital Library

Cited By

Carter SVan MYao JFilipowicz A(2024)Leveraging stencils and capacitive touch devices to iterate in-cabin UIsAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685012(277-280)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685012
Getschmann CEchtler FCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)LensLeech: On-Lens Interaction for Arbitrary Camera DevicesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633382(1-10)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633382
Ye QYong ZHan BYen CZheng C(2024)PaperTouch: Tangible Interfaces through Paper Craft and Touchscreen DevicesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642571(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642571
Show More Cited By

Index Terms

Clip-on gadgets: expanding multi-touch interaction area with unpowered tactile controls
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Recommendations

Clip-on gadgets: expandable tactile controls for multi-touch devices
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion

Virtual keyboards and controls, commonly used on mobile multi-touch devices, occlude content of interest and do not provide tactile feedback. Clip-on Gadgets solve these issues by extending the interaction area of multi-touch devices with physical ...
Thumb widgets: apply thumb-tracking to enhance capabilities of multi-touch on mobile devices
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

While multi-touch design allows natural and flexible figure gestures in interacting with mobile devices, the palm-size screen often limits its potential in application and arouses issues such as inefficient mode switch and incomplete gesture. To enrich ...
SLAP widgets: bridging the gap between virtual and physical controls on tabletops
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present Silicone iLluminated Active Peripherals (SLAP), a system of tangible, translucent widgets for use on multitouch tabletops. SLAP Widgets are cast from silicone or made of acrylic, and include sliders, knobs, keyboards, and buttons. They add ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

49
Total Citations
View Citations
1,411
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)4

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Carter SVan MYao JFilipowicz A(2024)Leveraging stencils and capacitive touch devices to iterate in-cabin UIsAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685012(277-280)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685012
Getschmann CEchtler FCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)LensLeech: On-Lens Interaction for Arbitrary Camera DevicesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633382(1-10)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633382
Ye QYong ZHan BYen CZheng C(2024)PaperTouch: Tangible Interfaces through Paper Craft and Touchscreen DevicesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642571(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642571
Ikematsu KKato K(2023)ShiftTouch: Extending Touchscreens with Passive Interfaces using Small Occluded Area for Discrete Touch InputProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572742(1-15)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572742
Okamoto MMurao K(2022)A Finger Sleeve with Fabricated Electrodes that Generates Multi-touch Interactions on Touch ScreenProceedings of the 2022 ACM International Symposium on Wearable Computers10.1145/3544794.3558473(54-58)Online publication date: 11-Sep-2022
https://dl.acm.org/doi/10.1145/3544794.3558473
Maeda TKuwayama KIto KFujita KItoh Y(2022)FullPull : A Stretchable UI to Input Pulling Strength on Touch SurfacesAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558775(1-3)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558775
Wang XKayukawa STakagi HAsakawa C(2022)BentoMuseum: 3D and Layered Interactive Museum Map for Blind VisitorsProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544811(1-14)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3544811
Yan YHuang ZXudu FYang Z(2022)Enabling Tangible Interaction on Non-touch Displays with Optical Mouse Sensor and Visible Light CommunicationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517666(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517666
Visschedijk AKim HTejada CAshbrook D(2022)ClipWidgets: 3D-printed Modular Tangible UI Extensions for SmartphonesProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501314(1-11)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501314
Okamoto MMurao K(2021)Multi-Touch Interaction Generation Device by Spatiotemporally Switching ElectrodesElectronics10.3390/electronics1012147510:12(1475)Online publication date: 19-Jun-2021
https://doi.org/10.3390/electronics10121475
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents