research-article

InformationSense: Trade-offs for the Design and the Implementation of a Large Highly Deformable Cloth Display

Authors:

Simon Butscher,

Maximilian Dürr,

Harald ReitererAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 1, Issue 2

Article No.: 7, Pages 1 - 28

https://doi.org/10.1145/3090053

Published: 30 June 2017 Publication History

Abstract

Deformable displays can provide two major benefits compared to rigid displays: Objects of different shapes and deformabilities, situated in our physical environment, can be equipped with deformable displays, and users can benefit from their pre-existing knowledge about the interaction with physical objects when interacting with deformable displays. In this article we present InformationSense, a large, highly deformable cloth display. The article contributes to two research areas in the context of deformable displays: It presents an approach for the tracking of large, highly deformable surfaces, and it presents one of the first UX analyses of cloth displays that will help with the design of future interaction techniques for this kind of display. The comparison of InformationSense with a rigid display interface unveiled the trade-off that while users are able to interact with InformationSense more naturally and significantly preferred InformationSense in terms of joy of use, they preferred the rigid display interfaces in terms of efficiency. This suggests that deformable displays are already suitable if high hedonic qualities are important but need to be enhanced with additional digital power if high pragmatic qualities are required.

Supplementary Material

butscher (butscher.zip)

Supplemental movie, appendix, image and software files for, InformationSense: Trade-offs for the Design and the Implementation of a Large Highly Deformable Cloth Display

Download
53.83 MB

References

[1]

Patrick Baudisch and Ruth Rosenholtz. 2003. Halo: a Technique for Visualizing Off-Screen Locations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘03), ACM Press (Ed.). New York, NY, USA, 481 - 488.

Digital Library

[2]

Jesse Burstyn, Juan Pablo Carrascal, and Roel Vertegaal. 2016. Fitts’ Law and the Effects of Input Mapping and Stiffness on Flexible Display Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘16). ACM Press, New York, NY, USA, 3649--3658.

Digital Library

[3]

Simon Butscher, Kasper Hornbæk, and Harald Reiterer. 2014. SpaceFold and PhysicLenses: Simultaneous Multifocus Navigation on Touch Surfaces. In Proceedings of the ACM International Working Conference on Advanced Visual Interfaces (AVI ‘14). ACM Press, New York, NY, USA, 209--216.

Digital Library

[4]

John Francis Canny. 1986. A Computational Approach to Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8, 6 (1986), 679--698.

Digital Library

[5]

Patrick Chiu, Chunyuan Liao, and Francine Chen. 2011. Multi-touch Document Folding: Gesture Models, Fold Directions and Symmetries. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘11). ACM Press, New York, NY, USA, 1591--1600.

Digital Library

[6]

Andy Cockburn, Amy Karlson, and Benjamin B. Bederson. 2008. A Review of Overview+Detail, Zooming, and Focus+Context Interfaces. ACM Computing Surveys (CSUR) 41, 1 (2008).

Digital Library

[7]

Niklas Elmqvist, Nathalie Henry, Yann Riche, and Jean-Daniel Fekete. 2008. Mélange: Space Folding for Multi-Focus Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘08). ACM Press, New York, NY, USA, 1333--1342.

Digital Library

[8]

Antonio Gomes and Roel Vertegaal. 2014. Paperfold: A Shape Changing Mobile Device with Multiple Reconfigurable Electrophoretic Magnetic Display Tiles. In Proceedings of the extended abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI EA ‘14). ACM Press, New York, NY, USA, 535--538.

Digital Library

[9]

Daniel Gotsch, Xuijing Zhang, Jesse Burstyn, and Roel Vertegaal. 2016. HoloFlex: A Flexible Holographic Smartphone with Bend Input. In Proceedings of the extended abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI EA ‘16). ACM Press, New York, NY, USA, 3675--3678.

Digital Library

[10]

Sean Gustafson, Patrick Baudisch, Carl Gutwin, and Pourang Irani. 2008. Wedge: Clutter-Free Visualization of Off-Screen Locations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘08). ACM Press, New York, NY, USA, 787--796.

Digital Library

[11]

Gero Herkenrath, T Karrer, and J Borchers. 2008. TWEND: Twisting and Bending as new Interaction Gesture in Mobile Devices. In Proceedings of the extended abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI EA ‘08). ACM Press, New York, NY, USA, 3819--3824.

Digital Library

[12]

Anna Hilsmann, David C. Schneider, and Peter Eisert. 2010. Realistic Cloth Augmentation in Single View Video under Occlusions. Computers and Graphics 34, 5 (2010), 567--574.

Digital Library

[13]

David Holman, Roel Vertegaal, Mark Altosaar, Nikolaus Troje, and Derek Johns. 2005. PaperWindows: Interaction Techniques for Digital Paper. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘05). ACM Press, New York, NY, USA, 591.

Digital Library

[14]

Rostislav Hulik, Vitezslav Beran, Michal Spanel, Premysl Krsek, and Pavel Smrz. 2012. Fast and accurate plane segmentation in depth maps for indoor scenes. In International Conference on Intelligent Robots and Systems (IROS ‘12). IEEE, Los Alamitos, CA, USA.

[15]

Shahram Izadi, David Kim, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, Jamie Shotton, Steve Hodges, Dustin Freeman, Andrew Davison, and Andrew Fitzgibbon. 2011. KinectFusion: Real-time 3D Reconstruction and Interaction Using a Moving Depth Camera. In Proceedings of the ACM symposium on User interface software and technology (UIST ‘11). ACM Press, New York, NY, USA, 559--568.

Digital Library

[16]

Robert J. K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Jamie Zigelbaum, Eric Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-Based Interaction: A Framework for Post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘08). ACM Press, New York, NY, USA, 201--210.

Digital Library

[17]

Waqas Javed, Sohaib Ghani, and Niklas Elmqvist. 2012. PolyZoom: Multiscale and Multifocus Exploration in 2D Visual Spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘12). ACM Press, New York, NY, USA, 287--296.

Digital Library

[18]

Mohammadreza Khalilbeigi, Roman Lissermann, Wolfgang Kleine, and Jürgen Steimle. 2012. FoldMe: Interacting with Double-sided Foldable Displays. In Proceedings of the ACM International Conference on Tangible, Embedded and Embodied Interaction (TEI ‘12), Vol. 1. ACM Press, New York, NY, USA, 33--40.

Digital Library

[19]

Christian Lander and Sven Gehring. 2014. ClothLens: Simultaneous Multi-User Interaction with Shared Content on a Tabletop. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS ‘11). ACM Press, New York, NY, USA, 415--418.

Digital Library

[20]

Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and Evaluation of a User Experience Questionnaire. In Proceedings of the Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society on HCI and Usability for Education and Work (USAB ‘08). Springer-Verlag, Berlin, DE, 63--76.

Digital Library

[21]

Sang-Su Lee, Sohyun Kim, Bopil Jin, Eunji Choi, Boa Kim, Xu Jia, Daeeop Kim, and Kun-pyo Lee. 2010. How Users Manipulate Deformable Displays as Input Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘10). ACM Press, New York, NY, USA, 1647--1656.

Digital Library

[22]

Meagan Leflar and Audrey Girouard. 2014. Navigating in 3D space with a handheld flexible device. Entertainment Computing 5, 4 (2014), 205--209.

[23]

Julian Lepinski and Roel Vertegaal. 2011. Cloth Displays: Interacting with Drapable Textile Screens. In Proceedings of the International Conference on Tangible, Embedded and Embodied Interaction (TEI ‘11). ACM Press, New York, NY, USA, 285--288.

Digital Library

[24]

David Lindlbauer, Jens Emil Grønbæk, Morten Birk, Kim Halskov, Marc Alexa, and Jörg Müller. 2016. Combining Shape-Changing Interfaces and Spatial Augmented Reality Enables Extended Object Appearance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘16). ACM Press, New York, NY, USA, 791--802.

Digital Library

[25]

Jessica Lo and Audrey Girouard. 2017. Bendy: Exploring Mobile Gaming with Flexible Devices. In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction. ACM Press, New York, NY, USA, 163--172.

Digital Library

[26]

Kimberly Mikulecky, Mark Hancock, John Brosz, and Sheelagh Carpendale. 2011. Exploring Physical Information Cloth on a Multitouch Table. In Proceedings of the International Conference on Interactive Tabletops and Surfaces (ITS ‘11). ACM Press, New York, NY, USA, 140--149.

Digital Library

[27]

Gaku Narita, Watanabe Masatoshi, and Yoshihiro Ishikawa. 2016. Dynamic Projection Mapping onto Deforming Non-Rigid Surface Using Deformable Dot Cluster Marker. IEEE Transactions on Visualization and Computer Graphics 23, 3 (2016), 1235--1248.

Digital Library

[28]

Gaku Narita, Yoshihiro Watanabe, and Masatoshi Ishikawa. 2015. Dynamic Projection Mapping Onto a Deformable Object with Occlusion Based on High-speed Tracking of Dot Marker Array. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology - VRST'15. ACM Press, New York, NY, USA, 149--152.

Digital Library

[29]

Hanhoon Park and Jong-Il Park. 2005. Invisible Marker-Based Augmented Reality System. Visual Communications and Image Processing 5960 (2005), 501--508.

[30]

Patrick Parzer, Kathrin Probst, Teo Babic, Christian Rendl, Anita Vogl, Alex Olwal, and Michael Haller. 2016. FlexTiles. In Proceedings of the extended abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI EA ‘16). ACM Press, New York, NY, USA, 3754--3757.

Digital Library

[31]

Ben Piper, Carlo Ratti, and Hiroshi Ishii. 2002. Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘02). ACM Press, New York, NY, USA, 355--362.

Digital Library

[32]

Christian Rendl, Michael Haller, Shahram Izadi, David Kim, Sean Fanello, Patrick Parzer, Christoph Rhemann, Jonathan Taylor, Martin Zirkl, Gregor Scheipl, and Thomas Rothländer. 2014. FlexSense: a transparent self-sensing deformable surface. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST ‘14). ACM Press, New York, NY, USA, 129--138.

Digital Library

[33]

Christian Rendl, David Kim, Patrick Parzer, Sean Fanello, Martin Zirkl, Gregor Scheipl, Michael Haller, and Shahram Izadi. 2016. FlexCase: Enhancing Mobile Interaction with a Flexible Sensing and Display Cover. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘16). ACM Press, New York, NY, USA, 5138--5150.

Digital Library

[34]

Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: Toward High “Shape Resolution” in Self-Actuated Flexible Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘13). ACM Press, New York, NY, USA, 593--602.

Digital Library

[35]

Deepak Ranjan Sahoo, Kasper Hornbæk, and Sriram Subramanian. 2016. TableHop: An Actuated Fabric Display Using Transparent Electrodes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘16). ACM Press, New York, NY, USA, 3767--3780.

Digital Library

[36]

Manojit Sarkar, Scott S. Snibbe, Oren Tversky, and Steven P. Reiss. 1993. Stretching the Rubber Sheet: A Metaphor for Viewing Large Layouts on Small Screens. In Proceedings of the ACM symposium on User interface software and technology (UIST ‘93). ACM Press, New York, NY, USA, 81--91.

Digital Library

[37]

Carsten Schwesig, Ivan Poupyrev, and Eijiro Mori. 2004. Gummi: A Bendable Computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘04). ACM Press, New York, NY, USA, 263 - 270.

Digital Library

[38]

Ben Shneiderman. 1996. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In Proceedings of the IEEE Symposium on Visual Languages (VL’ 96). IEEE, Los Alamitos, CA, USA, 336--343.

Digital Library

[39]

Olga Sorkine and Marc Alexa. 2007. As-Rigid-As-Possible Surface Modeling. In Proceedings of the Eurographics Symposium on Geometry Processing (SPG'07). Eurographics Association, Aire-la-Ville, CH, 109--116.

Digital Library

[40]

Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013. Flexpad: Highly Flexible Bending Interactions for Projected Handheld Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘13). ACM Press, New York, NY, USA, 237--246.

Digital Library

[41]

Giovanni Maria Troiano, Esben Warming Pedersen, and Kasper Hornbæk. 2014. User-Defined Gestures for Elastic, Deformable Displays. In Proceedings of the ACM International Working Conference on Advanced Visual Interfaces (AVI ‘14). ACM Press, New York, NY, USA, 1--8.

Digital Library

[42]

Aydin Varol, Mathieu Salzmann, Engin Tola, and Pascal Fua. 2009. Template-Free Monocular Reconstruction of Deformable Surfaces. In Proceedings of the IEEE International Conference on Computer Vision (ICCV ‘09). Los Alamitos, CA, USA, 1811--1818.

[43]

Yoshihiro Watanabe, Alvaro Cassinelli, Takashi Komuro, and Masatoshi Ishikawa. 2008. The Deformable Workspace: a Membrane between Real and Virtual Space. In Proceedings of the IEEE International Workshop on Horizontal Interactive Human Computer System (TABLETOP’ 08). IEEE, Los Alamitos, CA, USA, 145--152.

[44]

Mark Weiser. 1991. The computer for the 21st century. Mobile Computing and Communications Review 3, 3 (1991), 3--11.

Digital Library

[45]

Karl D. D. Willis, Takaaki Shiratori, and Moshe Mahler. 2013. HideOut: mobile projector interaction with tangible objects and surfaces. In International Conference on Tangible, Embedded and Embodied Interaction (TEI ‘13). ACM Press, New York, NY, USA, 331--338.

Digital Library

[46]

Kyungwon Yun, JunBong Song, Keehong Youn, Sungmin Cho, and Hyunwoo Bang. 2013. ElaScreen: Exploring Multi-dimensional Data using Elastic Screen. In Proceedings of the extended abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI EA ‘13). ACM Press, New York, NY, USA, 1311--1316.

Digital Library

Cited By

Rossmy BRümelin SWiethoff AKaltenbrunner MMurer MWolf KOakley I(2021)StringTouch - From String Instruments towards new Interface MorphologiesProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440628(1-10)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440628
Miyazaki DHashimoto N(2020)Marker Detection with Non-rigid Shape Estimation for Dynamic Projection Mapping動的Projection Mappingのための非剛体形状推定に基づくマーカ検出The Journal of The Institute of Image Information and Television Engineers10.3169/itej.74.20874:1(208-214)Online publication date: 2020
https://doi.org/10.3169/itej.74.208
Boem ATroiano GHarrison SBardzell SNeustaedter CTatar D(2019)Non-Rigid HCIProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322347(885-906)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322347
Show More Cited By

Index Terms

InformationSense: Trade-offs for the Design and the Implementation of a Large Highly Deformable Cloth Display
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Balloonygen: extended tabletop display embedded with balloon-like deformable spherical screen
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

Balloonygen, an extended tabletop display embedded with a balloon-like deformable spherical screen, is a display that can seamlessly expose a spherical screen for three-dimensional contents, such as omnidirectional images, in a conventional flat ...
Enabling beyond-surface interactions for interactive surface with an invisible projection
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

This paper presents a programmable infrared (IR) technique that utilizes invisible, programmable markers to support interaction beyond the surface of a diffused-illumination (DI) multi-touch system. We combine an IR projector and a standard color ...
Body-centric interaction techniques for very large wall displays
NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries

We examine the design space of interaction techniques for very large wall displays by drawing from existing theory and practice for reality-based interfaces and whole-body interfaces. We also apply insights drawn from research in psychology about the ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 1, Issue 2

June 2017

665 pages

EISSN:2474-9567

DOI:10.1145/3120957

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 June 2017

Accepted: 01 May 2017

Revised: 01 April 2017

Received: 01 February 2017

Published in IMWUT Volume 1, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
466
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rossmy BRümelin SWiethoff AKaltenbrunner MMurer MWolf KOakley I(2021)StringTouch - From String Instruments towards new Interface MorphologiesProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440628(1-10)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440628
Miyazaki DHashimoto N(2020)Marker Detection with Non-rigid Shape Estimation for Dynamic Projection Mapping動的Projection Mappingのための非剛体形状推定に基づくマーカ検出The Journal of The Institute of Image Information and Television Engineers10.3169/itej.74.20874:1(208-214)Online publication date: 2020
https://doi.org/10.3169/itej.74.208
Boem ATroiano GHarrison SBardzell SNeustaedter CTatar D(2019)Non-Rigid HCIProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322347(885-906)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322347
Girouard AShaer OSolovey EPoor GJacob R(2019)The Reality of Reality-Based InteractionACM Transactions on Computer-Human Interaction10.1145/331961726:5(1-35)Online publication date: 12-Sep-2019
https://dl.acm.org/doi/10.1145/3319617

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents