research-article

How users manipulate deformable displays as input devices

Authors:

Kun-pyo LeeAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1647 - 1656

https://doi.org/10.1145/1753326.1753572

Published: 10 April 2010 Publication History

Abstract

This study is aimed at understanding deformation-based user gestures by observing users interacting with artificial deformable displays with various levels of flexibility. We gained user-defined gestures that would help with the design and implementation of deformation-based interface, without considering current technical limitations. We found that when a display material gave more freedom from deformation, the level of consensus of gestures among the users as well as the intuitiveness and preferences were all enhanced. This study offers implications for deformation-based interaction which will be helpful for both designers and engineers who are trying to set the direction for future interface and technology development.

References

[1]

Akamatsu, M., MacKenzie, S.I., and Hasbrouc, T., A Comparison of Tactile, Auditory and Visual Feedback in a Pointing Task using a Mouse-Type device. Ergonomics, 38 (1995), 816--827.

[2]

Coelho, M., Poupyrev, I., Sadi, S., Vertegaal, R., Berzowska, J., Buechley, L., Maes, P., and Oxman, N. Programming reality: from transitive materials to organic user interfaces. Ext. Abstracts CHI 2009, ACM Press (2009), 4759--4762.

Digital Library

[3]

Efron, D. Gesture and Environment. King's Crown Press, New York, 1941.

[4]

Epps, J., Lichman, S., Wu, M. A study of hand shape use in tabletop gesture interaction. Ext. Abstracts CHI 2006, ACM Press (2006), 748--753.

Digital Library

[5]

Gallant, D.T., Seniuk, A.G., and Vertegaal, R. Towards more paper-like input: fexible input devices for foldable interaction styles. Proc. UIST 2008, ACM Press (2008), 283--286.

Digital Library

[6]

Goyal, N. COMET: Collaboration in Mobile Environments by Twisting. Proc. ECSCW 2009, 29.

[7]

Harrison, B.L., Fishkin, K.P., Gujar, A., Mochon, C., and Want, R. Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. Proc. CHI 1998, ACM Press (1998), 17--24.

Digital Library

[8]

Herkenrath, G., Karrer, T., and Borchers J. Twend: twisting and bending as new interaction gesture in mobile devices. Ext. Abstracts CHI 2008, ACM Press(2008), 3819--3824.

Digital Library

[9]

Holman, D., Vertegaal, R. and Altosaar, M. PaperWindows: Interaction Techniques for Digital Paper. Proc. CHI 2005, ACM Press (2005), 591--599.

Digital Library

[10]

Holman, D., Vertegaal, R. Organic user interfaces: designing computers in any way, shape, or form. Communications of the ACM 51, 6 (2008), 48--55.

Digital Library

[11]

Huang, T.-C., Tseng, H.-Y., Kung, C.-P., and Cheng, KT. Reliability Analysis for Flexible Electronics: Case Study of Integrated a-Si:H TFT Scan Driver. Proc. DAC 2007, 966--969.

Digital Library

[12]

Hutchins, E.L., Hollan, J.D. and Norman, D.A. Direct manipulation interfaces. Human-Computer Interaction 1, 4 (1985), 311--388.

Digital Library

[13]

Liu, J., Pinelle, D., Sallam, S., Subramanian, S. and Gutwin, C. TNT: Improved rotation and translation on digital tables. Proc. GI 2006. CIPS (2006), 25--32.

Digital Library

[14]

McNeill, D. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press (1992).

[15]

Michelitsch, G., Williams, J., Osen, M., Jimenez, B., Rapp, S. Haptic chameleon: a new concept of shape-changing user interface controls with force feedback. Ext. Abstracts CHI 2004, ACM Press(2004), 1305 -- 1308.

Digital Library

[16]

Morris, M.R., Huang, A., Paepcke, A. and Winograd, T. Cooperative gestures: Multi-user gestural interactions for co-located groupware. Proc. CHI 2006, ACM Press (2006), 1201--1210.

Digital Library

[17]

Murakami, T. and Nakajima, N. Direct and intuitive input device for 3-D shape deformation. Proc. CHI 1994, ACM Press (1994), 465--470.

Digital Library

[18]

Murakami, T., Hayashi, K., Oikawa, K., Nakajima N. DO-IT: Deformable Objects as Input Tools. Proc. CHI 1995, ACM Press (1995), 87--88.

Digital Library

[19]

Nielsen, M., Störring, M., Moeslund, T.B. and Granum, E. A procedure for developing intuitive and ergonomic gesture interfaces for HCI. Int'l Gesture Workshop 2003, LNCS vol. 2915. Springer-Verlag (2004), 409--420.

[20]

Schwesig, C., Poupyrev, I. and Mori, E. Gummi: User Interface for Deformable Computers. Proc. CHI 2003, ACM Press (2003), 954--955.

Digital Library

[21]

Snyder, C. Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces. Morgan Kaufmann, San Francisco, 2003.

Digital Library

[22]

Tajika, T., Yonezawa, T., Mitsunaga, N. Intuitive page-turning interface of e-books on flexible e-paper based on user studies. Proc. CHI 2008, ACM Press (2008), 793--796.

Digital Library

[23]

Van Dam, A. Post-WIMP user interfaces. Commun. ACM, 40, 2 (1997), 63--67.

Digital Library

[24]

Vertegaal, R. and Poupyrev I. Eek! a mouse! organic user interfaces: tangible, transitive materials and programmable reality. Ext. Abstacts CHI 2009, ACM Press (2009), 3313--3316.

Digital Library

[25]

Watanabe, J., Mochizuki, A., Horry, Y. Bookisheet: bendable device for browsing content using the metaphor of leafing through the pages. Proc. UbiComp 2008, ACM Press (2008), 360--369.

Digital Library

[26]

Wobbrock, J.O., Aung, H.H., Rothrock, B. and Myers, B.A. Maximizing the guessability of symbolic input. Ext. Abstracts CHI 2005, ACM Press (2005), 1869--1872.

Digital Library

[27]

Wobbrock, J.O., Morris, M.R., Wilson, A.D. User-defined gestures for surface computing. Proc. CHI 2009. ACM Press (2009), 1083--1092.

Digital Library

[28]

Zigelbaum, J., Chang, A., Gouldstone, J., Monzen, J.J., Ishii, H. SpeakCup: Simplicity, BABL, and Shape Change. Proc. TEI 2008. ACM Press (2008), 145--146.

Digital Library

[29]

Zigelbaum, J., Kumpf, A., Vazquez, A., Ishii, H. Slurp: tangibility spatiality and an eyedropper. Ext. Abstracts CHI 2008, ACM Press (2008), 2565--2574

Digital Library

Cited By

Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Savino GWahls JSchöning J(2024)Mobile Map Applications for Foldable DevicesProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656655(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656655
Andrei ABilius LVatavu R(2024)Take a Seat, Make a Gesture: Charting User Preferences for On-Chair and From-Chair Gesture InputProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642028(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642028
Show More Cited By

Index Terms

How users manipulate deformable displays as input devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

User-defined gestures for elastic, deformable displays
AVI '14: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces

Elastic, deformable displays allow users to give input by pinching, pushing, folding, and twisting the display. However, little is known about what gestures users prefer or how they will use elasticity and deformability as input. We report a guessability ...
Exploring the effects of size on deformable user interfaces
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion

Deformable user interfaces have received increasing attention in recent HCI research. However, the effect of device size on deformable user interfaces has not been studied yet. This study is aimed to investigate how the size of a deformable device ...
Caret Manipulation using Deformable Input in Mobile Devices
TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

Caret movement is difficult with touch input because of finger occlusion and the imprecision of interacting with a small display using fingers. We hypothesize that bend might provide a better text manipulation solution. We propose bend gestures to move ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

105
Total Citations
View Citations
2,433
Total Downloads

Downloads (Last 12 months)118
Downloads (Last 6 weeks)15

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Savino GWahls JSchöning J(2024)Mobile Map Applications for Foldable DevicesProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656655(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656655
Andrei ABilius LVatavu R(2024)Take a Seat, Make a Gesture: Charting User Preferences for On-Chair and From-Chair Gesture InputProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642028(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642028
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Muehlhaus MKoelle MSaberpour ASteimle J(2023)I Need a Third Arm! Eliciting Body-based Interactions with a Wearable Robotic ArmProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581184(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581184
Zhong CWakkary ROdom WWiberg MChen AOogjes DWhite JYoo M(2023)Exploring Long-Term Mediated Relations with a Shape-Changing Thing: A Field Study of coMorphing StoolProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581140(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581140
Bilius LUngurean OVatavu R(2023)Understanding Wheelchair Users’ Preferences for On-Body, In-Air, and On-Wheelchair GesturesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580929(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580929
Borah PSorathia K(2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
https://doi.org/10.1080/0144929X.2023.2245062
Li CLiang Q(2023)Interaction-Driven Design: A Case Study of Interactive LightingProceedings of Eighth International Congress on Information and Communication Technology10.1007/978-981-99-3091-3_61(733-743)Online publication date: 30-Jul-2023
https://doi.org/10.1007/978-981-99-3091-3_61
Chamunorwa MWozniak MVöge SMüller HBoll S(2022)Interacting with Rigid and Soft Surfaces for Smart-Home ControlProceedings of the ACM on Human-Computer Interaction10.1145/35467466:MHCI(1-22)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546746
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents