research-article

User-defined gestures for elastic, deformable displays

Authors:

Giovanni Maria Troiano,

Esben Warming Pedersen,

Kasper HornbækAuthors Info & Claims

AVI '14: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces

Pages 1 - 8

https://doi.org/10.1145/2598153.2598184

Published: 27 May 2014 Publication History

Abstract

Elastic, deformable displays allow users to give input by pinching, pushing, folding, and twisting the display. However, little is known about what gestures users prefer or how they will use elasticity and deformability as input. We report a guessability study where 17 participants performed gestures to solve 29 tasks, including selection, navigation, and 3D modeling. Based on the resulting 493 gestures, we describe a user-defined gesture set for elastic, deformable displays. We show how participants used depth and elasticity of the display to simulate deformation, rotation, and displacement of objects. In addition, we show how the use of desktop computers as well as multi-touch interaction affected users' choice of gestures. Finally, we discuss some unique uses of elasticity and deformability in gestures.

References

[1]

Bacim, F., Sinclair, M., and Benko, H. 2012. Challenges of Multitouch Interaction on Deformable Surfaces. In ITS'12. Beyond Flat Displays Workshop, ACM, Cambridge, Massachusetts, USA.

[2]

Cassinelli, A. and Ishikawa, M. 2005. Khronos projector. In Proc. ACM SIGGRAPH'05. Emerging technologies, Donna Cox (Ed.). ACM, New York, NY, USA, 10.

Digital Library

[3]

Gallant, D. T., Seniuk, A. G., and Vertegaal, R. 2008. Towards More Paper-like Input: Flexible Input Devices for Foldable Interaction Styles. In Proc. UIST'08, ACM, New York, NY, USA, 283--286.

Digital Library

[4]

Gründer, T., Kammer, D., Brade, M., and Groh, R. 2013. Towards a Design Space for Elastic Displays. In CHI'13. Workshop, Displays Take New Shape: An Agenda for Future Interactive Surfaces, ACM, New York, NY, USA, 1--4.

[5]

Kildal, J. 2012. Interacting with Deformable User Interfaces: Effect of Material Stiffness and Type of Deformation Gesture. In Proc. HAID'12, Charlotte Magnusson, Delphine Szymczak, and Stephen Brewster (Eds.). Springer-Verlag, Berlin, Heidelberg, 71--80.

Digital Library

[6]

Kray, C., Nesbitt, D., Dawson, J., and Rohs, M. 2010. User-defined gestures for connecting mobile phones, public displays, and tabletops. In Proc. MobileHCI'10, ACM, New York, NY, USA, 239--248.

Digital Library

[7]

Kwon, H., Bae, S.-H., Kim, H., and Lee, W. 2012. Inflated roly-poly. In Proc. TEI'12, Spencer (Ed.). ACM, New York, NY, USA, 189--192.

Digital Library

[8]

Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R. 2011. PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In Proc. CHI'11, ACM, New York, NY, USA, 1303--1312.

Digital Library

[9]

Lee, S., Lim, Y., and Lee, K.-P. 2012. Exploring the effects of size on deformable user interfaces. In Proc. MobileHCI'12, ACM, New York, NY, USA, 89--94.

Digital Library

[10]

Lee, S.-S., Kim, S., Jin, B., et al. 2010. How users manipulate deformable displays as input devices. In Proc. CHI'10, ACM, New York, NY, USA, 1647--1656.

Digital Library

[11]

Lepinski, J. and Vertegaal, R. 2011. Cloth displays: interacting with drapable textile screens. In Proc. TEI'11, ACM, New York, NY, USA, 285--288.

Digital Library

[12]

Makino, Y. and Kakehi, Y. 2011. Metamorphic light: a tabletop tangible interface using deformation of plain paper. In Proc. ACM SIGGRAPH'11. Posters, ACM, New York, NY, USA, 48.

Digital Library

[13]

Morris, M. R., Wobbrock, J. O., and Wilson, A. D. 2010. Understanding users' preferences for surface gestures. In Proc. GI'10, Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 261--268.

Digital Library

[14]

Oh, U. and Findlater, L. 2013. The challenges and potential of end-user gesture customization. In Proc. CHI'13, ACM, New York, NY, USA, 1129--1138.

Digital Library

[15]

Peschke, J., Göbel, F., Gründer, T., Keck, M., Kammer, D., and Groh, R. 2012. DepthTouch: an elastic surface for tangible computing. In Proc. AVI'12, Genny Tortora, Stefano Levialdi, and Maurizio Tucci (Eds.). ACM, New York, NY, USA, 770--771.

Digital Library

[16]

Piumsomboon, T., Clark, A., Billinghurst, M., and Cockburn, A. 2013. User-defined gestures for augmented reality. In Proc. CHI'13, ACM, New York, NY, USA, 955--960.

Digital Library

[17]

Piumsomboon, T., Clark, A., Billinghurst, M., and Cockburn, A. 2013. User-Defined Gestures for Augmented Reality. In Proc. INTERACT'13. Kotzé, G. Marsden, G. Lindgaard, J. Wesson and M. Winckler, (Eds.). Springer Berlin Heidelberg, 282--299.

[18]

Ruiz, J., Li, Y., and Lank, E. 2011. User-defined motion gestures for mobile interaction. In Proc. CHI'11, ACM, New York, NY, USA, 197--206.

Digital Library

[19]

Steimle, J., Jordt, A., and Maes, P. 2013. Flexpad: highly flexible bending interactions for projected handheld displays. In Proc. CHI'13, ACM, New York, NY, USA, 237--246.

Digital Library

[20]

Stevenson, A., Perez, C., and Vertegaal, R. 2011. An inflatable hemispherical multi-touch display. In Proc. TEI'11, ACM, New York, NY, USA, 289--292.

Digital Library

[21]

Vogt, F., Chen, T., Hoskinson, R., and Fels, S. 2004. A malleable surface touch interface. In Proc. ACM SIGGRAPH'04. Sketches, Ronen Barzel (Ed.). ACM, New York, NY, USA, 36--.

Digital Library

[22]

Warren, K., Lo, J., Vadgama, V., and Girouard, A. 2013. Bending the rules: bend gesture classification for flexible displays. In Proc. CHI'13, ACM, New York, NY, USA (2013), 607--610.

Digital Library

[23]

Watanabe, Y., Cassinelli, A., Komuro, T., and Ishikawa, M. 2008. The deformable workspace: A membrane between real and virtual space. In Proc. TABLETOP'08. 3rd IEEE International Workshop on Horizontal Interactive Human-Computer Systems, IEEE Computer Society, Washington, DC, USA, 145--152.

[24]

Wobbrock, J. O., Aung, H. H., Rothrock, B., and Myers, B. A. 2005. Maximizing the guessability of symbolic input. In Proc. CHI'05, ACM, New York, NY, USA, 1869--1872.

Digital Library

[25]

Wobbrock, J. O., Morris, M. R., and Wilson, A. D. 2009. User-defined gestures for surface computing. In Proc. CHI'09, ACM, New York, NY, USA, 1083--1092.

Digital Library

[26]

Ye, Z. and Khalid, H. 2010. Cobra: flexible displays for mobilegaming scenarios. In Proc. CHI'10, ACM, New York, NY, USA, 4363--4368.

Digital Library

[27]

Yun, K., Song, J., Youn, K., Cho, S., and Bang, H. 2013. ElaScreen: exploring multi-dimensional data using elastic screen. In Proc. CHI'13, ACM, New York, NY, USA, 1311--1316.

Digital Library

[28]

eTable: A haptic elastic table for 3D multi-touch interations - YouTube. http://www.youtube.com/watch?v=v2A4bLSiX6A.

[29]

Kreek Prototype 2.1 | Kinect Hacks. http://www.kinecthacks.com/kreek-prototype-2-1/.

[30]

ActiveCurtain Design. http://sid.desiign.org/portfolio/activecurtain-design/.

[31]

Cloud Pink @ Exhibitions | everyware. http://everyware.kr/home/cloud-pink-exhibitions/.

[32]

Elastic 'Firewall' tests the boundaries of life and death through touch and sound | The Verge. http://www.theverge.com/2012/12/19/3783500/firewall-installation-art-membrane-music-experience.

[33]

impress - a flexible display, final documentation. http://www.silkehilsing.de/impress/blog/?cat=5.

Cited By

Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Müller MKammer DFranke I(2024)Kickstarting Application Development for Elastic Displays with Do-it-yourself Hardware Assembly InstructionsProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656678(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656678
Alsebayel GNasri MMyers CTroiano GHatamimajoumerd EOstadabbas SAllison KHarteveld C(2024)ArticuMotion: Towards Assessing Motor Speech Disorders via GamificationProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655815(232-247)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655815
Show More Cited By

Index Terms

User-defined gestures for elastic, deformable displays
1. Human-centered computing

Recommendations

User-defined gestures for surface computing
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Many surface computing prototypes have employed gestures created by system designers. Although such gestures are appropriate for early investigations, they are not necessarily reflective of user behavior. We present an approach to designing tabletop ...
User-defined gestures for free-hand TV control
EuroITV '12: Proceedings of the 10th European Conference on Interactive TV and Video

As researchers and industry alike are proposing TV interfaces that use gestures in their designs, understanding users' preferences for gesture commands becomes an important problem. However, no rules or guidelines currently exist to assist designers and ...
User-defined gestures for augmented reality
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Recently there has been an increase in research of hand gestures for interaction in the area of Augmented Reality (AR). However this research has focused on developer designed gestures, and little is known about user preference and behavior for gestures ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AVI '14: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces

May 2014

438 pages

ISBN:9781450327756

DOI:10.1145/2598153

General Chair:
Paolo Paolini
Politecnico di Milano (Italy)
,
Program Chair:
Franca Garzotto
Politecnico di Milano (Italy)

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Centro Cultura Volta: Centro Cultura Volta
Politecnico di Milano: Politecnico di Milano

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 May 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Seventh Framework Programme

Conference

AVI' 14

Sponsor:

Centro Cultura Volta
Politecnico di Milano

AVI' 14: International Working Conference on Advanced Visual Interfaces

May 27 - 29, 2014

Como, Italy

Acceptance Rates

AVI '14 Paper Acceptance Rate 32 of 112 submissions, 29%;

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

60
Total Citations
View Citations
1,068
Total Downloads

Downloads (Last 12 months)87
Downloads (Last 6 weeks)7

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Eady AGuerrero ACheung VThue DGirouard A(2024)BendAide: A Deformable Interface to Augment Touchscreen Mobile DevicesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670960(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670960
Müller MKammer DFranke I(2024)Kickstarting Application Development for Elastic Displays with Do-it-yourself Hardware Assembly InstructionsProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656678(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656678
Alsebayel GNasri MMyers CTroiano GHatamimajoumerd EOstadabbas SAllison KHarteveld C(2024)ArticuMotion: Towards Assessing Motor Speech Disorders via GamificationProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655815(232-247)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655815
Nash JSteer CDinca TSharma AFavaratto Santos AWildgoose BAger AClarke CAlexander J(2024)DeformIO: Dynamic Stiffness Control on a Deformable Force-sensing DisplayExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650772(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650772
Miner NAbdollahi AMyers CKosa MGhaednia HSchwab JHarteveld CTroiano G(2024)Stairway to Heaven: A Gamified VR Journey for Breath AwarenessProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641986(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641986
Steer CSauvé KJain ALawal OProulx MJicol CAlexander J(2024)Squishy, Yet Satisfying: Exploring Deformable Shapes' Cross-Modal Correspondences with Colours and EmotionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641952(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641952
Sun LZhang HChen PJiang ZXie XZhou ZLiu XChen X(2024)Elicitation and Evaluation of Hand-based Interaction Language for 3D Conceptual Design in Mixed RealityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103198183:COnline publication date: 14-Mar-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103198
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Shultz CHarrison C(2023)Flat Panel Haptics: Embedded Electroosmotic Pumps for Scalable Shape DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581547(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581547
Jamalzadeh MRekik YDancu AGrisoni L(2023)Hap2Gest: An Eyes-Free Interaction Concept with Smartphones Using Gestures and Haptic FeedbackHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_31(479-500)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_31
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents