Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3322276.3322347acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

Non-Rigid HCI: A Review of Deformable Interfaces and Input

Published: 18 June 2019 Publication History

Abstract

Deformable interfaces are emerging in HCI and prototypes show potential for non-rigid interactions. Previous reviews looked at deformation as a material property of shape-changing interfaces and concentrated on output. As such,deformable input was under-discussed. We distinguish deformable from shape-changing interfaces to concentrate on input. We survey 131 papers on deformable interfaces and review their key design elements (e.g., shape, material) based on how they support input. Our survey shows that deformable input was often used to augment or replace rigid input, particularly on elastic and flexible displays. However, when shapes and materials guide interactions, deformable input was used to explore new HCI paradigms, where gestures are potentially endless, and input become analogy to sculpting, metaphor to non-verbal communication, and expressive controls are enhanced. Our review provides designers and practitioners with a baseline for designing deformable interfaces and input methodically. We conclude by highlighting under-explored areas and identify research goals to tackle in future work with deformable interfaces.

Supplementary Material

ZIP File (disfp1362.zip)
Auxiliary Material: 01_Database_deformable_interfaces.xlsx A spreadsheet containing all the interfaces analyzed in this paper. For every interface we summarized the main characteristics for each category (use, shape, material, sensing, etc?) 02_List-Papers_Proceedings-Journals.xlsx A spreadsheet containing all the interfaces analyzed in this paper, divided by type of proceedings, journals, books, and organized in chronological order. 03_Analysis_RealTimeBoard.pdf A series of screenshots of the analysis conducted by the authors using Realtime Board. 04_Quantitative_Analysis.xlsx A spreadsheet containing the results of a quantitative analysis of the data.

References

[1]
2013. Kinect Hacks | Kreek Prototype 2.1. (2013). http://www.kinecthacks.com/kreek-prototype-2--1/ Retrieved: 2018-07--20.
[2]
2018. Apple continues their work on a Folding iPhone by focusing on new Flexible Sensors, a new Flexible Battery & Circuits. Patently Apple. (13 Sep 2018).
[3]
Teemu T. Ahmaniemi, Johan Kildal, and Merja Haveri. 2014. What is a Device Bend Gesture Really Good for?. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3503--3512.
[4]
Jason Alexander, Anne Roudaut, Jürgen Steimle, Kasper Hornbæk, Miguel Bruns Alonso, Sean Follmer, and Timothy Merritt. 2018. Grand Challenges in Shape-Changing Interface Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 299, 14 pages.
[5]
Rufino Ansara and Audrey Girouard. 2014. Augmenting Bend Gestures with Pressure Zones on Flexible Displays. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices; Services (MobileHCI '14). ACM, New York, NY, USA, 531--536.
[6]
Felipe Bacim, Mike Sinclair, and Hrvoje Benko. 2012. Challenges of Multitouch Interaction on Deformable Surfaces. In In ITS'12. Beyond Flat Displays Workshop. ACM, Cambridge, Massachusetts, USA. http://displayworkshop.media.mit.edu/ITS2012/ downloads/paper-Bacim.pdf
[7]
Felipe Bacim, Mike Sinclair, and Hrvoje Benko. 2013. Understanding Touch Selection Accuracy on Flat and Hemispherical Deformable Surfaces. In Proceedings of Graphics Interface 2013 (GI '13). Canadian Information Processing Society, Canada, 197--204. http://dl.acm.org/citation.cfm?id=2532129.2532163
[8]
Gavin Bailey, Deepak Sahoo, and Matt Jones. 2017. Paper for E-Paper: Towards Paper Like Tangible Experience Using E-Paper. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, New York, NY, USA, 446--449.
[9]
Ravin Balakrishnan, George Fitzmaurice, Gordon Kurtenbach, and Karan Singh. 1999. Exploring Interactive Curve and Surface Manipulation Using a Bend and Twist Sensitive Input Strip. In Proceedings of the 1999 Symposium on Interactive 3D Graphics (I3D '99). ACM, New York, NY, USA, 111--118.
[10]
Wouter M. Bergmann Tiest. 2010. Tactual perception of material properties. Vision Research 50, 24 (2010), 2775 -- 2782.
[11]
Wouter M. Bergmann Tiest and Astrid M. L. Kappers. 2009. Cues for Haptic Perception of Compliance. IEEE Transactions on Haptics 2, 4 (Oct 2009), 189--199.
[12]
Tristan Beven, Thuong Hoang, Marcus Carter, and Bernd Ploderer. 2016. HandLog: A Deformable Tangible Device for Continuous Input Through Finger Flexion. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (OzCHI '16). ACM, New York, NY, USA, 595--604.
[13]
H. R. Beyer and K. Holtzblatt. 1997. Contextual Design: Defining Customer-Centered Systems. Morgan Kaufmann, 1st Edition, Burlington, MA, USA.
[14]
José María Blanco, Pascal Landry, Sebastián Mealla C., Emanuela Mazzone, and Narcís Parés. 2010. PIPLEX: Tangible Experience in an Augmented Reality Video Game. In Proceedings of the 9th International Conference on Interaction Design and Children (IDC '10). ACM, New York, NY, USA, 274--277.
[15]
Kerl Bodker, Finn Kensing, and Jesper Simonsen. 2014. Participatory It Design: Designing for Business and Workplace Realities. MIT Press.
[16]
Alberto Boem. 2014. SculpTon: A malleable tangible interface for sound sculpting. In Proceedings of the 2014 Joint International Computer Music Conference and Sound and Music Computing (ICMC+SMC). ICMA, San Francisco, CA, USA, 737--743. https://quod.lib.umich.edu/i/icmc/bbp2372.2014.115/1
[17]
Bert Bongers and Yolande Harris. 2002. A Structured Instrument Design Approach: The Video-Organ. In Proceedings of the International Conference on New Interfaces for Musical Expression (24--26 May, 2002). Dublin, Ireland, 18--23. http: //www.nime.org/proceedings/2002/nime2002_018.pdf
[18]
Anders Brodersen, Monika Büscher, Michael Christensen, Mette Agger Eriksen, Kaj Grønbæk, Jannie Friis Kristensen, Gunnar Kramp, Peter Krogh, Martin Ludvigsen, Preben Holst Mogensen, Michael Bang Nielsen, Dan Shapiro, and Peter Orbaek. 2007. The Disappearing Computer. Springer-Verlag, Berlin, Heidelberg, Chapter Spatial Computing and Spatial Practices, 77--95. http://dl.acm.org/citation.cfm?id=1768246.1768251
[19]
Jesse Burstyn, Amartya Banerjee, and Roel Vertegaal. 2013. FlexView: An Evaluation of Depth Navigation on Deformable Mobile Devices. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 193--200.
[20]
Jesse Burstyn, Juan Pablo Carrascal, and Roel Vertegaal. 2016. Fitts' Law and the Effects of Input Mapping and Stiffness on Flexible Display Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3649--3658.
[21]
Simon Butscher, Maximilian Dürr, and Harald Reiterer. 2017. InformationSense: Trade-offs for the Design and the Implementation of a Large Highly Deformable Cloth Display. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2, Article 7 (jun 2017), 28 pages.
[22]
William D. Callister. 2004. Fundamentals of Materials Science and Engineering. John Wiley and Sons, USA.
[23]
Baptiste Caramiaux, Jules Françoise, Norbert Schnell, and Frédéric Bevilacqua. 2014. Mapping Through Listening. Computer Music Journal 38, 3 (2014), 34--48.
[24]
Alvaro Cassinelli and Masatoshi Ishikawa. 2005. Khronos Projector. In ACM SIGGRAPH 2005 Emerging Technologies (SIGGRAPH '05). ACM, New York, NY, USA, Article 10.
[25]
Angela Chang and Hiroshi Ishii. 2007. 2007. Zstretch: A Stretchy Fabric Music Controller. In In Proc. NIME'07. 7th International Conference on New Interfaces for Musical Expression. ACM, New York, NY, USA, 46--49.
[26]
Victor Cheung, Alexander Keith Eady, and Audrey Girouard. 2018. Deformable Controllers: Fabrication and Design to Promote Novel Hand Gestural Interaction Mechanisms. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). ACM, New York, NY, USA, 732--735.
[27]
Chin-yu Chien, Cheng-Yuan Li, Liwei Chan, Yi-Chi Liao, Rong-Hao Liang, Hao-hua Chu, and Bing-Yu Chen. 2015. fStrip: A Malleable Shape-retaining Wearable Strip for Interface On-demand. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (UbiComp/ISWC'15 Adjunct). ACM, New York, NY, USA, 105--108.
[28]
Franceli L. Cibrian, Oscar Peña, Deysi Ortega, and Monica Tentori. 2017. BendableSound: An elastic multisensory surface using touch-based interactions to assist children with severe autism during music therapy. International Journal of Human-Computer Studies 107 (2017), 22 -- 37.
[29]
Marcelo Coelho and Jamie Zigelbaum. 2011. Shape-changing Interfaces. Personal Ubiquitous Comput. 15, 2 (feb 2011), 161--173.
[30]
Farshad Daliri and Audrey Girouard. 2016. Visual Feedforward Guides for Performing Bend Gestures on Deformable Prototypes. In Proceedings of the 42Nd Graphics Interface Conference (GI '16). Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada, 209--216.
[31]
Brendan Dawes. 2006. Analog In, Digital Out: Brendan Dawes on Interaction Design. New Riders Publishing, USA.
[32]
Massimiliano Di Luca. 2014. Multisensory Softness: Perceived Compliance from Multiple Sources of Information. Springer.
[33]
Connor Dickie, Nicholas Fellion, and Roel Vertegaal. 2012. FlexCam: Using Thin-film Flexible OLED Color Prints As a Camera Array. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1051--1054.
[34]
Rhys Duindam, Diemo Schwarz, and Hans Leeuw. 2015. Tingle: A Digital Music Controller Re-Capturing the Acoustic Instrument Experience. In Proceedings of the International Conference on New Interfaces for Musical Expression, Edgar Berdahl and Jesse Allison (Eds.). Louisiana State University, Baton Rouge, Louisiana, USA, 219--222. http: //www.nime.org/proceedings/2015/nime2015_319.pdf
[35]
Matthew Ernst and Audrey Girouard. 2016a. Bending Blindly: Exploring Bend Gestures for the Blind. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 2088--2096.
[36]
Matthew Ernst and Audrey Girouard. 2016b. Exploring Haptics for Learning Bend Gestures for the Blind. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 2097--2104.
[37]
Matthew Ernst, Travis Swan, Victor Cheung, and Audrey Girouard. 2017. Typhlex: Exploring Deformable Input for Blind Users Controlling a Mobile Screen Reader. IEEE Pervasive Computing 16, 4 (October 2017), 28--35.
[38]
Elias Fares, Victor Cheung, and Audrey Girouard. 2017. Effects of Bend Gesture Training on Learnability and Memorability in a Mobile Game. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, New York, NY, USA, 240--245.
[39]
Nicholas Fellion, Thomas Pietrzak, and Audrey Girouard. 2017. FlexStylus: Leveraging Bend Input for Pen Interaction. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 375--385.
[40]
Sidney Fels, Ashley Gadd, and Axel Mulder. 2002. Mapping Transparency Through Metaphor: Towards More Expressive Musical Instruments. Organized Sound 7, 2 (Aug. 2002), 109--126.
[41]
Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47, 6 (1954), 381--391.
[42]
Sean Follmer, Micah Johnson, Edward Adelson, and Hiroshi Ishii. 2011. deForm: An Interactive Malleable Surface for Capturing 2.5D Arbitrary Objects, Tools and Touch. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 527--536.
[43]
Sean Follmer, Daniel Leithinger, Alex Olwal, Nadia Cheng, and Hiroshi Ishii. 2012. Jamming User Interfaces: Programmable Particle Stiffness and Sensing for Malleable and Shape-changing Devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 519--528.
[44]
Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: Dynamic Physical Affordances and Constraints Through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 417--426.
[45]
David T. Gallant, Andrew G. Seniuk, and Roel Vertegaal. 2008. Towards More Paper-like Input: Flexible Input Devices for Foldable Interaction Styles. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 283--286.
[46]
George A. Gescheider. 2013. Psychophysics : The Fundamentals. Psychology Press, USA.
[47]
Audrey Girouard, Jessica Lo, Md Riyadh, Farshad Daliri, Alexander Keith Eady, and Jerome Pasquero. 2015. One-Handed Bend Interactions with Deformable Smartphones. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1509--1518.
[48]
Barney Glaser and Anselm Strauss. 2000. The Discovery of Grounded Theory: Strategies for Qualitative Research. Routledge, USA.
[49]
Oliver Glauser, Daniele Panozzo, Otmar Hilliges, and Olga Sorkine-Hornung. 2018. Deformation Capture via Self-Sensing Capacitive Arrays. CoRR abs/1804.04013 (2018). http://arxiv.org/abs/1804.04013
[50]
Antonio Gomes, Lahiru Priyadarshana, Juan Pablo Carrascal, and Roel Vertegaal. 2016. WhammyPhone: Exploring Tangible Audio Manipulation Using Bend Input on a Flexible Smartphone. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 159--161.
[51]
Daniel Gotsch, Xujing Zhang, Juan Pablo Carrascal, and Roel Vertegaal. 2016. HoloFlex: A Flexible Light-Field Smartphone with a Microlens Array and a P-OLED Touchscreen. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 69--79.
[52]
Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark Patterns in Proxemic Interactions: A Critical Perspective. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). ACM, New York, NY, USA, 523--532.
[53]
Mick Grierson and Chris Kiefer. 2013. NoiseBear: A Malleable Wireless Controller Designed In Participation with Disabled Children. In Proceedings of the International Conference on New Interfaces for Musical Expression. Daejeon, Republic of Korea, 413--416. http://nime.org/proceedings/2013/nime2013_227.pdf
[54]
Erik Grönvall, Sofie Kinch, Marianne Graves Petersen, and Majken K. Rasmussen. 2014. Causing Commotion with a Shape-changing Bench: Experiencing Shape-changing Interfaces in Use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2559--2568.
[55]
Jaehyun Han, Jiseong Gu, and Geehyuk Lee. 2014. Trampoline: A Double-sided Elastic Touch Device for Creating Reliefs. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 383--388.
[56]
Ed Hardy. 2018. Apple lays groundwork for bendable iPhone. Cult of Mac. (April 2018).
[57]
John Hardy, Christian Weichel, Faisal Taher, John Vidler, and Jason Alexander. 2015. ShapeClip: Towards Rapid Prototyping with Shape-Changing Displays for Designers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 19--28.
[58]
Shuji Hashimoto and Hideyuki Sawada. 2005. A Grasping Device to Sense Hand Gesture for Expressive Sound Generation. Journal of New Music Research 34, 1 (2005), 115--123.
[59]
Gero Herkenrath, Thorsten Karrer, and Jan Borchers. 2008. Twend: Twisting and Bending As New Interaction Gesture in Mobile Devices. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, 3819--3824.
[60]
David Holman, Audrey Girouard, Hrvoje Benko, and Roel Vertegaal. 2013. The Design of Organic User Interfaces: Shape, Sketching and Hypercontext. Interacting with Computers 25, 2 (feb 2013), 133--142.
[61]
Andy Hunt, Marcelo M. Wanderley, and Ross Kirk. 2000. Towards a model for instrumental mapping in expert musical interaction. In Proceedings of the 2000 International Computer Music Conference. Berlin, Germany.
[62]
H. Ishii, C. Ratti, B. Piper, Y. Wang, A. Biderman, and E. Ben-Joseph. 2004. Bringing Clay and Sand into Digital Design- Continuous Tangible user Interfaces. BT Technology Journal 22, 4 (oct 2004), 287--299.
[63]
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '97). ACM, New York, NY, USA, 234--241.
[64]
Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX: Adding Haptic Surface to Graphics. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 469--476.
[65]
Hiroo Iwata, Hiroaki Yano, and Naoto Ono. 2005. Volflex. In ACM SIGGRAPH 2005 Emerging Technologies (SIGGRAPH '05). ACM, New York, NY, USA, Article 31.
[66]
Robert J. K. Jacob, Linda E. Sibert, Daniel C. McFarlane, and M. Preston Mullen, Jr. 1994. Integrality and Separability of Input Devices. ACM Trans. Comput.-Hum. Interact. 1, 1 (mar 1994), 3--26.
[67]
Dhruv Jain, Graysen Babbitt, Emma Pearl Canning, and Willmer-Shiles. 2016. Towards Interactive Force-Sensitive Digitally Encoded Materials for Architectural Models and Construction. In Workshop paper on Future of Human-Building Interaction of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). http://human-ist.unifr.ch/sites/human-ist.unifr.ch/ files/7-CHI2016-NervousBlocks_v5.0_DJ_CAMERA.pdf
[68]
Yvonne Jansen. 2010. Mudpad: Fluid Haptics for Multitouch Surfaces. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, New York, NY, USA, 4351--4356.
[69]
Alexander Refsum Jensenius and Michael J. Lyons. 2017. A NIME Reader. Springer, Cham.
[70]
Alexander Refsum Jensenius and Arve Voldsund. 2012. The Music Ball Project: Concept, Design, Development, Performance. In Proceedings of the International Conference on New Interfaces for Musical Expression. University of Michigan, Ann Arbor, Michigan. http: //www.nime.org/proceedings/2012/nime2012_161.pdf
[71]
Martin Kaltenbrunner. 2009. reacTIVision and TUIO: A Tangible Tabletop Toolkit. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 9--16.
[72]
Kazuto Kamiyama, Hiroyuki Kajimoto, Naoki Kawakami, and Susumu Tachi. 2004. Evaluation of a vision-based tactile sensor. In IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004, Vol. 2. 1542--1547 Vol.2.
[73]
C. H.-L. Kao, E. Dreshaj, J. Amores, S.-w. Leigh, X. Benavides, P. Maes, K. Perlin, and H. Ishii. 2015. Clayodor: Retrieving Scents Through the Manipulation of Malleable Material. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 697--702.
[74]
Maria Karam and M. C. Schraefel. 2005. A taxonomy of gestures in human computer interactions. Technical Report. University of Southampton.
[75]
Yuichiro Katsumoto, Satoru Tokuhisa, and Masa Inakage. 2013. Ninja Track: Design of Electronic Toy Variable in Shape and Flexibility. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 17--24.
[76]
Sean Keach. 2018. INTO THE FOLD LG foldable smartphone leaks as a possible Samsung Galaxy X rival -- we reveal secret pictures of the mystery phone. The Sun. (22 Jan 2018).
[77]
Chris Kiefer. 2010. A Malleable Interface for Sonic Exploration. In Proceedings of the International Conference on New Interfaces for Musical Expression. Sydney, Australia, 291--296. http: //www.nime.org/proceedings/2010/nime2010_291.pdf
[78]
Johan Kildal. 2012. Interacting with Deformable User Interfaces: Effect of Material Stiffness and Type of Deformation Gesture. In Proceedings of the 7th International Conference on Haptic and Audio Interaction Design (HAID'12). Springer-Verlag, Berlin, 71--80.
[79]
Johan Kildal and Marion Boberg. 2013. Feel the Action: Dynamic Tactile Cues in the Interaction with Deformable Uis. In In CHI'13 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 1563--1568.
[80]
Johan Kildal, Andrés Lucero, and Marion Boberg. 2013. Twisting Touch: Combining Deformation and Touch As Input Within the Same Interaction Cycle on Handheld Devices. In Proceedings of the 15th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '13). ACM, New York, NY, USA, 237--246.
[81]
Johan Kildal, Susanna Paasovaara, and Viljakaisa Aaltonen. 2012. Kinetic Device: Designing Interactions with a Deformable Mobile Interface. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1871--1876.
[82]
Johan Kildal and Graham Wilson. 2012. Feeling It: The Roles of Stiffness, Deformation Range and Feedback in the Control of Deformable Ui. In Proceedings of the 14th ACM International Conference on Multimodal Interaction (ICMI '12). ACM, New York, NY, USA, 393--400.
[83]
Hyunyoung Kim, Celine Coutrix, and Anne Roudaut. 2018. Morphees+: Studying Everyday Reconfigurable Objects for the Design and Taxonomy of Reconfigurable UIs. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 619, 14 pages.
[84]
Jaemin Kim, Jongsu Lee, Donghee Son, Moon Kee Choi, and Dae-Hyeong Kim. 2016. Deformable devices with integrated functional nanomaterials for wearable electronics. Nano Convergence 3, 1 (15 Mar 2016), 4.
[85]
Seoktae Kim, Hyunjung Kim, Boram Lee, Tek-Jin Nam, and Woohun Lee. 2008. Inflatable Mouse: Volume-adjustable Mouse with Air-pressure-sensitive Input and Haptic Feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 211--224.
[86]
Phil Kingsley. 2013. eTable: A haptic elastic table for 3D multi-touch interations. (2013). Retrieved September 15, 2019 from https://www.youtube.com/watch?v=GY22EU9Z-0g.
[87]
Yuichiro Kinoshita, Masato Nishio, Shota Shiraga, and Kentaro Go. 2018. Investigation of Pleasantness in the Manipulation of Deformable Interfaces for Musical Expression. In Linkoping Electronic Conference Proceedings. Linkoping University Electronic Press, Linköpings universitet, 315--324.
[88]
Konstantin Klamka and Raimund Dachselt. 2015. Elasticcon: Elastic Controllers for Casual Interaction. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 410--419.
[89]
Roberta L. Klatzky, Dianne Pawluk, and Angelika Peer. 2013. Haptic Perception of Material Properties and Implications for Applications. Proc. IEEE 101, 9 (Sept 2013), 2081--2092.
[90]
Jeffrey Tzu Kwan Valino Koh, Kasun Karunanayaka, Jose Sepulveda, Mili J. Tharakan, Manoj Krishnan, and Adrian D. Cheok. 2011. Liquid Interface: A Malleable, Transient, Direct-touch Interface. Comput. Entertain. 9, 2, Article 7 (jul 2011), 8 pages.
[91]
Hyosun Kwon, Seok-Hyung Bae, Hwan Kim, and Woohun Lee. 2012. Inflated Roly-poly. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (TEI '12). ACM, New York, NY, USA, 189--192.
[92]
Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. PaperPhone: Understanding the Use of Bend Gestures in Mobile Devices with Flexible Electronic Paper Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1303--1312.
[93]
Chris Larson, Josef Spjut, Ross A. Knepper, and Robert F. Shepherd. 2017. OrbTouch: Recognizing Human Touch in Deformable Interfaces with Deep Neural Networks. CoRR abs/1706.02542 (2017). http://arxiv.org/abs/1706.02542
[94]
Vincent LeClerc, Amanda Parkes, and Hiroshi Ishii. 2007. Senspectra: A Computationally Augmented Physical Modeling Toolkit for Sensing and Visualization of Structural Strain. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 801--804.
[95]
Susan J. Lederman and Roberta L. Klatzky. 2009. Haptic perception: A tutorial. Attention, Perception, & Psychophysics 71, 7 (01 Oct 2009), 1439--1459.
[96]
Sang-Su Lee, Sohyun Kim, Bopil Jin, Eunji Choi, Boa Kim, Xu Jia, Daeeop Kim, and Kun-pyo Lee. 2010. How Users Manipulate Deformable Displays As Input Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1647--1656.
[97]
Sang-su Lee, Youn-kyung Lim, and Kun-Pyo Lee. 2012. Exploring the Effects of Size on Deformable User Interfaces. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services Companion (MobileHCI '12). ACM, New York, NY, USA, 89--94.
[98]
Sang-Su Lee, Seungwoo Maeng, Daeeop Kim, Kun-Pyo Lee, Wonkyum Lee, Sangsik Kim, and Sungkwan Jung. 2011. FlexRemote: Exploring the Effectiveness of Deformable User Interface as an Input Device for TV. In HCI International 2011 -- Posters' Extended Abstracts, Constantine Stephanidis (Ed.). Springer, Berlin, 62--65.
[99]
Daniel Leithinger, Sean Follmer, Alex Olwal, Samuel Luescher, Akimitsu Hogge, Jinha Lee, and Hiroshi Ishii. 2013. Sublimate: State-changing Virtual and Physical Rendering to Augment Interaction with Shape Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1441--1450.
[100]
Daniel Leithinger and Hiroshi Ishii. 2010. Relief: A Scalable Actuated Shape Display. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10). ACM, New York, NY, USA, 221--222.
[101]
Julian Lepinski and Roel Vertegaal. 2011. Cloth Displays: Interacting with Drapable Textile Screens. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, New York, NY, USA, 285--288.
[102]
Jessica Lo and Audrey Girouard. 2017. Bendy: Exploring Mobile Gaming with Flexible Devices. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). ACM, New York, NY, USA, 163--172.
[103]
Qiuyu Lu, Chengpeng Mao, Liyuan Wang, and Haipeng Mi. 2016. LIME: LIquid MEtal Interfaces for Non-Rigid Interaction. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 449--452.
[104]
Aurélien Lucchi, Patrick Jermann, Guillaume Zufferey, and Pierre Dillenbourg. 2010. An Empirical Evaluation of Touch and Tangible Interfaces for Tabletop Displays. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10). ACM, New York, NY, USA, 177--184.
[105]
Cathy A. Malchiodi. 2006. Expressive therapies. Guilford Press, USA.
[106]
Joseph Malloch, Stephen Sinclair, Avrum Hollinger, and Marcelo M. Wanderley. 2011. Input Devices and Music Interaction. Springer Berlin Heidelberg, Berlin, Heidelberg, 67--83.
[107]
J. Malloch, S. Sinclair, and M. M. Wanderley. 2018. Generalized Multi-Instance Control Mapping for Interactive Media Systems. IEEE MultiMedia 25, 1 (Jan 2018), 39--50.
[108]
Sana Maqsood, Sonia Chiasson, and Audrey Girouard. 2016. Bend Passwords: Using Gestures to Authenticate on Flexible Devices. Personal Ubiquitous Comput. 20, 4 (aug 2016), 573--600.
[109]
Martin Marier. 2010. The Sponge A Flexible Interface. In Proceedings of the International Conference on New Interfaces for Musical Expression. Sydney, Australia, 356--359. http://www.nime.org/proceedings/2010/nime2010_356.pdf
[110]
Martin Marier. 2014. Designing Mappings for the Sponge: Towards Spongistic Music. In Proceedings of the International Conference on New Interfaces for Musical Expression. Goldsmiths, University of London, London, United Kingdom, 525--528. http: //www.nime.org/proceedings/2014/nime2014_292.pdf
[111]
Nicolai Marquardt, Johannes Kiemer, and Saul Greenberg. 2010. What Caused That Touch?: Expressive Interaction with a Surface Through Fiduciary-tagged Gloves. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 139--142.
[112]
Yasushi Matoba, Toshiki Sato, Nobuhiro Takahashi, and Hideki Koike. 2012. ClaytricSurface: An Interactive Surface with Dynamic Softness Control Capability. In In Proc. ACM SIGGRAPH'12. Emerging Technologies. ACM, New York, NY, USA, 6:1--6:1.
[113]
Matthias Milczynski, Thomas Hermann, Till Bovermann, and Helge Ritter. 2006. A malleable device with applications to sonification-based data exploration. In In Proc. ICAD'06. 12th International Conference on Auditory Display. London, UK, 69--76.
[114]
Eduardo Reck Miranda and Marcelo Wanderley. 2006. New Digital Musical Instruments: Control And Interaction Beyond the Keyboard (Computer Music and Digital Audio Series). A-R Editions, Inc., USA.
[115]
Geoffrey C. Morris, Sasha Leitman, and Marina Kassianidou. 2004. SillyTone Squish Factory. In Proceedings of the International Conference on New Interfaces for Musical Expression. Hamamatsu, Japan, 201--202. http: //www.nime.org/proceedings/2004/nime2004_201.pdf
[116]
Axel G. E. Mulder and Sidney Fels S. 1998. Sound Sculpting: Manipulating Sound through Virtual Sculpting. In Proceedings of Western Computer Graphics Symposium 1998.
[117]
Tamotsu Murakami and Naomasa Nakajima. 1994. Direct and Intuitive Input Device for 3-D Shape Deformation. In Conference Companion on Human Factors in Computing Systems (CHI '94). ACM, New York, NY, USA, 233--236.
[118]
Tamotsu Murakami and Naomasa Nakajima. 2000. DO-IT: deformable object as input tool for 3-D geometric operation. Computer-Aided Design 32, 1 (2000), 5 -- 16.
[119]
Yusuke Nakagawa, Akiya Kamimura, and Yoichiro Kawaguchi. 2012. MimicTile: A Variable Stiffness Deformable User Interface for Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 745--748.
[120]
Kosuke Nakajima, Yuichi Itoh, Yusuke Hayashi, Kazuaki Ikeda, Kazuyuki Fujita, and Takao Onoye. 2013. Emoballoon: A balloon-shaped interface recognizing social touch interactions. In 2013 IEEE Virtual Reality (VR). 1--4.
[121]
Satoshi Nakamaru, Ryosuke Nakayama, Ryuma Niiyama, and Yasuaki Kakehi. 2017. FoamSense: Design of Three Dimensional Soft Sensors with Porous Materials. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 437--447.
[122]
Vinh P. Nguyen, Sang Ho Yoon, Ansh Verma, and Karthik Ramani. 2014. BendID: Flexible Interface for Localized Deformation Recognition. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 553--557.
[123]
Jaime Oliver and Mathew Jenkins. 2008. The Silent Drum Controller: A New Percussive Gestural Interface. In Proceedings of the 2008 International Computer Music Conference (ICMC'08). International Computer Music Association, New York, NY, USA. https://quod.lib.umich.edu/i/icmc/bbp2372.2008.118/1
[124]
Alex Olwal, Jon Moeller, Greg Priest-Dorman, Thad Starner, and Ben Carroll. 2018. I/O Braid: Scalable Touch-Sensitive Lighted Cords Using Spiraling, Repeating Sensing Textiles and Fiber Optics. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings, UIST 2018, Berlin, Germany, October 14--17, 2018. 203--207.
[125]
Jifei Ou, Lining Yao, Daniel Tauber, Jürgen Steimle, Ryuma Niiyama, and Hiroshi Ishii. 2013. jamSheets: Thin Interfaces with Tunable Stiffness Enabled by Layer Jamming. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 65--72.
[126]
Dan Overholt. 2001. The MATRIX : A Novel Controller for Musical Expression. In Proceedings of the International Conference on New Interfaces for Musical Expression. Seattle, WA, 38--41. http: //www.nime.org/proceedings/2001/nime2001_038.pdf
[127]
Amanda Parkes, Vincent LeClerc, and Hiroshi Ishii. 2006. Glume: Exploring Materiality in a Soft Augmented Modular Modeling System. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). ACM, New York, NY, USA, 1211--1216.
[128]
Patrick Parzer, Adwait Sharma, Anita Vogl, Jürgen Steimle, Alex Olwal, and Michael Haller. 2017. SmartSleeve: Real-time Sensing of Surface and Deformation Gestures on Flexible, Interactive Textiles, Using a Hybrid Gesture Detection Pipeline. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 565--577.
[129]
Joshua Peschke, Fabian Göbel, Thomas Gründer, Mandy Keck, Dietrich Kammer, and Rainer Groh. 2012. DepthTouch: An Elastic Surface for Tangible Computing. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12). ACM, New York, NY, USA, 770--771.
[130]
David Phelan. 2018. Forget Samsung Galaxy X. Apple Is Developing A Foldable iPhone For 2020, Analyst Says. Forbes. (23 March 2018).
[131]
Ben Piper, Carlo Ratti, and Hiroshi Ishii. 2002. Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, New York, NY, USA, 355--362.
[132]
Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. 2013. DeforMe: Projection-based Visualization of Deformable Surfaces Using Invisible Textures. In SIGGRAPH Asia 2013 Emerging Technologies (SA '13). ACM, New York, NY, USA, Article 8, 3 pages.
[133]
Isabel P. S. Qamar, Rainer Groh, David Holman, and Anne Roudaut. 2018. HCI Meets Material Science: A Literature Review of Morphing Materials for the Design of Shape-Changing Interfaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 374, 23 pages.
[134]
Raf Ramakers, Johannes Schöning, and Kris Luyten. 2014. Paddle: Highly Deformable Mobile Devices with Physical Controls. In In Proc. CHI'14. Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2569--2578.
[135]
Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk. 2012. Shape-changing Interfaces: A Review of the Design Space and Open Research Questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 735--744.
[136]
Majken K. Rasmussen, Giovanni M. Troiano, Marianne G. Petersen, Jakob G. Simonsen, and Kasper Hornbæk. 2016. Sketching Shape-changing Interfaces: Exploring Vocabulary, Metaphors Use, and Affordances. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2740--2751.
[137]
Carlo Ratti, Yao Wang, Ben Piper, Hiroshi Ishii, and Assaf Biderman. 2004. PHOXEL-SPACE: An Interface for Exploring Volumetric Data with Physical Voxels. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '04). ACM, New York, NY, USA, 289--296.
[138]
Michael Reed. 2009. Prototyping Digital Clay As an Active Material. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (TEI '09). ACM, New York, NY, USA, 339--342.
[139]
Christian Rendl, David Kim, Sean Fanello, Patrick Parzer, Christoph Rhemann, Jonathan Taylor, Martin Zirkl, Gregor Scheipl, Thomas Rothländer, Michael Haller, and Shahram Izadi. 2014. FlexSense: A Transparent Self-sensing Deformable Surface. In In Proc. UIST'14 ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 129--138.
[140]
Simon Robinson, Céline Coutrix, Jennifer Pearson, Juan Rosso, Matheus Fernandes Torquato, Laurence Nigay, and Matt Jones. 2016. Emergeables: Deformable Displays for Continuous Eyes-Free Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3793--3805.
[141]
James Rogerson. 2018. Samsung Galaxy X: the story of Samsung's foldable phone so far. TechRadar. (10 Sep 2018).
[142]
Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: Toward High "Shape Resolution" in Self-actuated Flexible Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 593--602.
[143]
Deepak Ranjan Sahoo, Kasper Hornbæk, and Sriram Subramanian. 2016. TableHop: An Actuated Fabric Display Using Transparent Electrodes. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3767--3780.
[144]
Mirza Saquib Sarwar, Yuta Dobashi, Claire Preston, Justin K. M. Wyss, Shahriar Mirabbasi, and John David Wyndham Madden. 2017. Bend, stretch, and touch: Locating a finger on an actively deformed transparent sensor array. Science Advances 3, 3 (2017).
[145]
Toshiki Sato, Haruko Mamiya, Hideki Koike, and Kentaro Fukuchi. 2009. PhotoelasticTouch: Transparent Rubbery Tangible Interface Using an LCD and Photoelasticity. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). ACM, New York, NY, USA, 43--50.
[146]
Toshiki Sato, Jefferson Pardomuan, Yasushi Matoba, and Hideki Koike. 2014. ClaytricSurface: An Interactive Deformable Display with Dynamic Stiffness Control. IEEE Computer Graphics and Applications 34, 3 (May 2014), 59--67.
[147]
Matthieu Savary, Diemo Schwarz, and Denis Pellerin. 2012. DIRTI -Dirty Tangible Interfaces. In Proceedings of the International Conference on New Interfaces for Musical Expression. University of Michigan, Ann Arbor, Michigan. http: //www.nime.org/proceedings/2012/nime2012_212.pdf
[148]
Vlad Savov. 2019. Huawei's Mate X foldable phone is a thinner 5G rival to the Galaxy Fold - The Verge. http://tinyurl.com/yxqjjv7r. (2019).
[149]
Hideyuki Sawada, Naoyuki Onoe, and Shuji Hashimoto. 1997. Sounds in Hands: A Sound Modifier Using Datagloves and Twiddle Interface. In Proceedings of the 1997 International Computer Music Conference (ICMC'97). ICMA, San Francisco, CA, USA. http://hdl.handle.net/2027/spo.bbp2372.1997.082
[150]
Matthew Schmidtbauer, Samuel Johnson, Jeffrey Jalkio, and AnnMarie Thomas. 2012. Squishy Circuits As a Tangible Interface. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 2111--2116.
[151]
Martin Schmitz, Jürgen Steimle, Jochen Huber, Niloofar Dezfuli, and Max Mühlhäuser. 2017. Flexibles: Deformation-Aware 3D-Printed Tangibles for Capacitive Touchscreens. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1001--1014.
[152]
Carsten Schwesig, Ivan Poupyrev, and Eijiro Mori. 2004. Gummi: A Bendable Computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 263--270.
[153]
Orit Shaer and Eva Hornecker. 2010. 2010. Tangible User Interfaces: Past, Present, and Future Directions. Found. Trends Hum.-Comput. Interact. 3, 1--2 (2010), 1--137.
[154]
Yuebo Shen, Keqin Dou, and Jiawei Gu. 2013. RoCuModel: An Iterative Tangible Modeling System. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 73--76.
[155]
Jia Sheng, Ravin Balakrishnan, and Karan Singh. 2006. An Interface for Virtual 3D Sculpting via Physical Proxy. In In Proc. GRAPHITE'06. 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia. ACM, New York, NY, USA, 213--220.
[156]
Paden Shorey and Audrey Girouard. 2017. Bendtroller: An Exploration of In-Game Action Mappings with a Deformable Game Controller. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1447--1458.
[157]
Eric Singer. 2003. Sonic Banana: A Novel Bend-Sensor-Based MIDI Controller. In Proceedings of the International Conference on New Interfaces for Musical Expression. Montreal, Canada, 220--221. http: //www.nime.org/proceedings/2003/nime2003_220.pdf
[158]
Ronit Slyper, Ivan Poupyrev, and Jessica Hodgins. 2011. Sensing Through Structure: Designing Soft Silicone Sensors. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, New York, NY, USA, 213--220.
[159]
Ross T. Smith, Bruce H. Thomas, and Wayne Piekarski. 2008. Digital Foam Interaction Techniques for 3D Modeling. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (VRST '08). ACM, New York, NY, USA, 61--68.
[160]
Charles Spence. 2011. Crossmodal correspondences: A tutorial review. Attention, Perception, & Psychophysics 73, 4 (01 May 2011), 971--995.
[161]
M. A. Srinivasan and R. H. LaMotte. 1995. Tactual discrimination of softness. Journal of Neurophysiology 73, 1 (1995), 88--101.
[162]
Jürgen Steimle, Hrvoje Benko, Alvaro Cassinelli, Hiroshi Ishii, Daniel Leithinger, Pattie Maes, and Ivan Poupyrev. 2013a. Displays take new shape: an agenda for future interactive surfaces. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 3283--3286.
[163]
Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013b. Flexpad: Highly Flexible Bending Interactions for Projected Handheld Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 237--246.
[164]
Steven E. Stemler. 2015. Content Analysis. American Cancer Society, 1--14.
[165]
Paul Strohmeier, Juan Pablo Carrascal, Bernard Cheng, Margaret Meban, and Roel Vertegaal. 2016. An Evaluation of Shape Changes for Conveying Emotions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3781--3792.
[166]
Miriam Sturdee and Jason Alexander. 2018. Analysis and Classification of Shape-Changing Interfaces for Design and Application-based Research. ACM Comput. Surv. 51, 1, Article 2 (jan 2018), 32 pages.
[167]
Yuta Sugiura, Masahiko Inami, and Takeo Igarashi. 2012. A Thin Stretchable Interface for Tangential Force Measurement. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 529--536.
[168]
Yuta Sugiura, Gota Kakehi, Anusha Withana, Calista Lee, Daisuke Sakamoto, Maki Sugimoto, Masahiko Inami, and Takeo Igarashi. 2011. Detecting Shape Deformation of Soft Objects Using Directional Photoreflectivity Measurement. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 509--516.
[169]
Koray Tahiroglu, Thomas Svedström, Valtteri Wikström, Simon Overstall, Johan Kildal, and Teemu Ahmaniemi. 2014. SoundFLEX: Designing Audio to Guide Interactions with Shape-Retaining Deformable Interfaces. In Proceedings of the 16th International Conference on Multimodal Interaction (ICMI '14). ACM, New York, NY, USA, 267--274.
[170]
Dominique Tan, Maciej Kumorek, Andres A. Garcia, Adam Mooney, and Derek Bekoe. 2015. Projectagami: A Foldable Mobile Device with Shape Interactive Applications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1555--1560.
[171]
Aneesh P. Tarun, Peng Wang, Audrey Girouard, Paul Strohmeier, Derek Reilly, and Roel Vertegaal. 2013. PaperTab: an electronic paper computer with multiple large flexible electrophoretic displays. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 3131--3134.
[172]
Giovanni Maria Troiano, Esben Warming Pedersen, and Kasper Hornbæk. 2014. User-defined Gestures for Elastic, Deformable Displays. In In Proc. AVI'14 International Working Conference on Advanced Visual Interfaces. ACM, New York, NY, USA, 1--8. 00000.
[173]
Giovanni Maria Troiano, Esben Warming Pedersen, and Kasper Hornbæk. 2015. Deformable Interfaces for Performing Music. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 377--386.
[174]
Giovanni Maria Troiano, John Tiab, and Youn-Kyung Lim. 2016. SCI-FI: Shape-Changing Interfaces, Future Interactions. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, New York, NY, USA, Article 45, 10 pages.
[175]
Yuta Ujiie, Wakayo Yamashita, Waka Fujisaki, So Kanazawa, and Masami K Yamaguchi. 2018. Crossmodal association of auditory and visual material properties in infants. Scientific reports 8, 1 (2018), 9301.
[176]
John Underkoffler and Hiroshi Ishii. 1999. Urp: A Luminous-tangible Workbench for Urban Planning and Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 386--393.
[177]
Nirzaree Vadgama and Jürgen Steimle. 2017. Flexy: Shape-Customizable, Single-Layer, Inkjet Printable Patterns for 1D and 2D Flex Sensing. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). ACM, New York, NY, USA, 153--162.
[178]
Karen Vanderloock, Vero Vanden Abeele, Johan A.K. Suykens, and Luc Geurts. 2013. The Skweezee System: Enabling the Design and the Programming of Squeeze Interactions. In In Proc. UIST'13. Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 521--530.
[179]
Marynel Vázquez, Eric Brockmeyer, Ruta Desai, Chris Harrison, and Scott E. Hudson. 2015. 3D Printing Pneumatic Device Controls with Variable Activation Force Capabilities. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1295--1304.
[180]
Anita Vogl, Patrick Parzer, Teo Babic, Joanne Leong, Alex Olwal, and Michael Haller. 2017. StretchEBand: Enabling Fabric-based Interactions Through Rapid Fabrication of Textile Stretch Sensors. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 2617--2627.
[181]
Florian Vogt, Timothy Chen, Reynald Hoskinson, and Sidney Fels. 2004. A malleable surface touch interface. In In Proc. ACM SIGGRAPH'04. Sketches. Ronen Barzel (Ed.). ACM, New York, NY, USA, 36--.
[182]
Akira Wakita, Akito Nakano, and Nobuhiro Kobayashi. 2011a. Programmable Blobs: A Rheologic Interface for Organic Shape Design. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, New York, NY, USA, 273--276.
[183]
Akira Wakita, Akito Nakano, and Michihiko Ueno. 2011b. SMAAD surface: A tangible interface for smart material aided architectural design. In Proceedings of the 16th International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2011). 355--364.
[184]
X. Wang and A. D. Cheok. 2011. ClayStation: A Mixed Reality Gaming Platform Supporting Playful Learning for Children. In Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology (ACE '11). ACM, New York, NY, USA, Article 69, 2 pages.
[185]
Kristen Warren, Jessica Lo, Vaibhav Vadgama, and Audrey Girouard. 2013. Bending the Rules: Bend Gesture Classification for Flexible Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 607--610.
[186]
Tom Warren. 2019. Samsung's foldable phone is the $1,980 Galaxy Fold - The Verge. http://tinyurl.com/y4powub3. (2019).
[187]
Chihiro Watanabe, Alvaro Cassinelli, Yoshihiro Watanabe, and Masatoshi Ishikawa. 2014. Generic Method for Crafting Deformable Interfaces to Physically Augment Smartphones. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14). ACM, New York, NY, USA, 1309--1314.
[188]
Eri Watanabe, Yuta Hanzawa, and Masa Inakage. 2007. Clay Tone: A Music System Using Clay for User Interaction. In In SIGGRAPH'07 Posters. ACM, New York, NY, USA.
[189]
Yoshihiro Watanabe, Alvaro Cassinelli, Takashi Komuro, and Masatoshi Ishikawa. 2008. The deformable workspace: A membrane between real and virtual space. In 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems. 145--152.
[190]
Martin Weigel and Jürgen Steimle. 2017. DeformWear: Deformation Input on Tiny Wearable Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2, Article 28 (jun 2017), 23 pages.
[191]
Gil Weinberg. 2002. Playpens, Fireflies and Squeezables: New Musical Instruments for Bridging the Thoughtful and the Joyful. Leonardo Music Journal 12 (2002), 43--51.
[192]
Gil Weinberg and Seum-Lim Gan. 2001. The Squeezables: Toward an Expressive and Interdependent Multi-player Musical Instrument. Computer Music Journal 25, 2 (2001), 37--45.
[193]
Gili Weinberg, Maggie Orth, and Peter Russo. 2000. The Embroidered Musical Ball: A Squeezable Instrument for Expressive Performance. In CHI '00 Extended Abstracts on Human Factors in Computing Systems (CHI EA '00). ACM, New York, NY, USA, 283--284.
[194]
Michael Wessely, Theophanis Tsandilas, and Wendy E. Mackay. 2016. Stretchis: Fabricating Highly Stretchable User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 697--704.
[195]
Irmandy Wicaksono and Joseph Paradiso. 2017. FabricKeyboard: Multimodal Textile Sensate Media as an Expressive and Deformable Musical Interface. In Proceedings of the International Conference on New Interfaces for Musical Expression. 348--353. http://www. nime.org/proceedings/2017/nime2017_paper0066.pdf
[196]
Irmandy Wicaksono, Caroline Rozendo, Runzhou Ye, Jaleesa Trapp, V. Michael Bove Jr., Canan Dagdeviren, and Hiroshi Ishii. 2018. PerForm: Deformable Interface for Exploring Sound Through Shapes. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Article LBW605, 6 pages.
[197]
Valtteri Wikström, Simon Overstall, Koray Tahiroglu, Johan Kildal, and Teemu Ahmaniemi. 2013. MARSUI: Malleable Audio-reactive Shape-retaining User Interface. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 3151--3154.
[198]
Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In In Proc. CHI'09. ACM, New York, NY, USA, 1083--1092. http://dl.acm.org/citation.cfm?id=1518866
[199]
Junichi Yamaoka and Yasuaki Kakehi. 2012. NeonDough: Crafting with Interactive Lighted Clay. In ACM SIGGRAPH 2012 Posters (SIGGRAPH '12). ACM, New York, NY, USA, Article 74, 1 pages.
[200]
Zi Ye and Hammad Khalid. 2010. Cobra: Flexible Displays for Mobilegaming Scenarios. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, New York, NY, USA, 4363--4368.
[201]
Sang Ho Yoon, Ke Huo, and Karthik Ramani. 2016. Wearable textile input device with multimodal sensing for eyes-free mobile interaction during daily activities. Pervasive and Mobile Computing 33 (2016), 17 -- 31.
[202]
Sang Ho Yoon, Ke Huo, Yunbo Zhang, Guiming Chen, Luis Paredes, Subramanian Chidambaram, and Karthik Ramani. 2017. iSoft: A Customizable Soft Sensor with Real-time Continuous Contact and Stretching Sensing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017, Quebec City, QC, Canada, October 22 - 25, 2017. 665--678.
[203]
Sang Ho Yoon, Luis Paredes, Ke Huo, and Karthik Ramani. 2018. MultiSoft: Soft Sensor Enabling Real-Time Multimodal Sensing with Contact Localization and Deformation Classification. IMWUT 2, 3 (2018), 145:1--145:21.
[204]
Kyungwon Yun, JunBong Song, Keehong Youn, Sungmin Cho, and Hyunwoo Bang. 2013. ElaScreen: Exploring Multi-dimensional Data Using Elastic Screen. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 1311--1316.
[205]
Marc Zadel, Paul Kosek, and Marcelo M. Wanderley. 2003. A Pliable, Inertial Interface. Technical Report. (2003). http://www.idmil.org/projects/pliable_inertial

Cited By

View all
  • (2024)Contact Resistance Sensing for Touch and Squeeze InteractionsMultimodal Technologies and Interaction10.3390/mti80200148:2(14)Online publication date: 17-Feb-2024
  • (2024)Exploring the Somatic Possibilities of Shape Changing Car SeatsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661518(3354-3371)Online publication date: 1-Jul-2024
  • (2024)DeformIO: Dynamic Stiffness Control on a Deformable Force-sensing DisplayExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650772(1-8)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference
June 2019
1628 pages
ISBN:9781450358507
DOI:10.1145/3322276
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. bendable displays
  2. deformable interfaces
  3. flexible interfaces
  4. input
  5. mapping
  6. material
  7. non-rigid interactions
  8. organic displays
  9. sensing
  10. shape
  11. shape-changing interfaces

Qualifiers

  • Research-article

Conference

DIS '19
Sponsor:
DIS '19: Designing Interactive Systems Conference 2019
June 23 - 28, 2019
CA, San Diego, USA

Acceptance Rates

DIS '19 Paper Acceptance Rate 105 of 415 submissions, 25%;
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)368
  • Downloads (Last 6 weeks)32
Reflects downloads up to 12 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Contact Resistance Sensing for Touch and Squeeze InteractionsMultimodal Technologies and Interaction10.3390/mti80200148:2(14)Online publication date: 17-Feb-2024
  • (2024)Exploring the Somatic Possibilities of Shape Changing Car SeatsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661518(3354-3371)Online publication date: 1-Jul-2024
  • (2024)DeformIO: Dynamic Stiffness Control on a Deformable Force-sensing DisplayExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650772(1-8)Online publication date: 11-May-2024
  • (2024)Challenges and Opportunities of LLM-Based Synthetic Personae and Data in HCIExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636293(1-5)Online publication date: 11-May-2024
  • (2024)Squishy, Yet Satisfying: Exploring Deformable Shapes' Cross-Modal Correspondences with Colours and EmotionsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641952(1-20)Online publication date: 11-May-2024
  • (2024)Force-regulated Elastic Linear Objects Tracking for Virtual and Augmented Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00086(661-669)Online publication date: 16-Mar-2024
  • (2023)Demonstrating LattiSense: A 3D-Printable Resistive Deformation Sensor with Lattice StructuresProceedings of the 8th ACM Symposium on Computational Fabrication10.1145/3623263.3629161(1-2)Online publication date: 8-Oct-2023
  • (2023)WireShape - A Hybrid Prototyping Process for Fast & Reliable Manufacturing of Inflatable Interface Props with CNC-Fabricated Heat–Sealing ToolsProceedings of the 8th ACM Symposium on Computational Fabrication10.1145/3623263.3623363(1-8)Online publication date: 8-Oct-2023
  • (2023)LattiSense: A 3D-Printable Resistive Deformation Sensor with Lattice StructuresProceedings of the 8th ACM Symposium on Computational Fabrication10.1145/3623263.3623361(1-14)Online publication date: 8-Oct-2023
  • (2023)Exploring Dynamic Vibrotactile Feedback for Layer-based Interaction on Elastic DisplaysProceedings of Mensch und Computer 202310.1145/3603555.3608534(406-411)Online publication date: 3-Sep-2023
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media