research-article

Button+: Supporting User and Context Aware Interaction through Shape-Changing Interfaces

Authors:

Andrea BianchiAuthors Info & Claims

TEI '17: Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction

Pages 261 - 268

https://doi.org/10.1145/3024969.3024980

Published: 20 March 2017 Publication History

Abstract

Shape-changing interfaces are an emerging topic in HCI research: they merge the simplicity of tangible interfaces with the expressiveness of dynamic physical affordances. However, while prior work largely focused on technical aspects and proposed classifications of shape-changing interfaces based on the physical properties of the actuators and the user's levels of control, this work presents a classification of shape-changing interfaces based on the context and identity of the users. After introducing a new prototype for a shape-changing pushbutton, we conducted a series of workshop studies with designers and engineers to explore the design space and potential applications for this interface. We used the result of our workshops to propose a generalized taxonomy of interactions, and built two applications that reflect the proposed model. The paper concludes by highlighting future possible research directions for context and user aware shape-changing interfaces.

Supplementary Material

suppl.mov (teifp0165-file4.mp4)

Supplemental video

Download
55.49 MB

References

[1]

Jason Alexander, John Hardy, and Stephen Wattam. 2014. Characterising the Physicality of Everyday Buttons. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14). ACM, NY, NY, USA, 205--208.

Digital Library

[2]

Gilles Bailly, Thomas Pietrzak, Jonathan Deber, and Daniel J. Wigdor. 2013. Métamorphe: augmenting hotkey usage with actuated keys. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NY, NY, USA, 563--572.

Digital Library

[3]

BMW iDrive: http://www.bmw.com/com/en/insights/technology/tech nology_guide/articles/idrive.html {Last access August 2016}

[4]

Marcelo Coelho, Hiroshi Ishii, and Pattie Maes. 2008. Surflex: a programmable surface for the design of tangible interfaces. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, NY, NY, USA, 3429--3434.

Digital Library

[5]

Marcelo Coelho and Jamie Zigelbaum. Shape-changing interfaces. Personal Ubiquitous Computing 15, 2 (2010), 161--173.

Digital Library

[6]

Aluna Everitt, Faisal Taher, and Jason Alexander. 2016. ShapeCanvas: An Exploration of ShapeChanging Content Generation by Members of the Public. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 2778--2782.

Digital Library

[7]

Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: dynamic physical affordances and constraints through shape and object actuation. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13). ACM, NY, NY, USA, 417--426.

Digital Library

[8]

John Hardy, Christian Weichel, Faisal Taher, John Vidler, and Jason Alexander. 2015. ShapeClip: Towards Rapid Prototyping with Shape-Changing Displays for Designers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 19--28.

Digital Library

[9]

Chris Harrison and Scott E. Hudson. 2009. Providing dynamically changeable physical buttons on a visual display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, NY, NY, USA, 299--308.

Digital Library

[10]

Kate Hartman, Jackson McConnell, Boris Kourtoukov, Hillary Predko, and Izzie Colpitts-Campbell. 2015. Monarch: Self-Expression Through Wearable Kinetic Textiles. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, NY, NY, USA, 413--414.

Digital Library

[11]

Fabian Hemmert, Susann Hamann, Matthias Löwe, Anne Wohlauf, and Gesche Joost. 2010. Shapechanging mobiles: tapering in one-dimensional deformational displays in mobile phones. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction (TEI '10). ACM, NY, NY, USA, 249--252.

Digital Library

[12]

Fabian Hemmert, Gesche Joost, André Knörig, and Reto Wettach. 2008. Dynamic knobs: shape change as a means of interaction on a mobile phone. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, NY, NY, USA, 2309--2314.

Digital Library

[13]

Jeong-ki Hong, Sunghyun Song, Jundong Cho, and Andrea Bianchi. 2015. Better Posture Awareness through Flower-Shaped Ambient Avatar. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, NY, NY, USA, 337--340.

Digital Library

[14]

Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: beyond tangible bits, toward transformable materials. interactions 19, 1 (January 2012), 38--51.

Digital Library

[15]

Hiroshi Ishii and Brygg Ullmer. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems (CHI '97). ACM, NY, NY, USA, 234--241.

Digital Library

[16]

Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX: adding haptic surface to graphics. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques (SIGGRAPH '01). ACM, NY, NY, USA, 469--476.

Digital Library

[17]

Lars-Erik Janlert. 2014. The Ubiquitous Button. interactions 21, 3: 26--33.

Digital Library

[18]

Takaharu Kanai, Yuya Kikukawa, Tatsuhiko Suzuki, Tetsuaki Baba, and Kumiko Kushiyama. 2011. PocoPoco: a tangible device that allows users to play dynamic tactile interaction. In ACM SIGGRAPH 2011 Emerging Technologies (SIGGRAPH '11). ACM, NY, NY, USA, Article 12, 1 pages.

Digital Library

[19]

Seoktae Kim, Hyunjung Kim, Boram Lee, Tek-Jin Nam, and Woohun Lee. 2008. Inflatable mouse: volume-adjustable mouse with air-pressure-sensitive input and haptic feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, NY, NY, USA, 211--224.

Digital Library

[20]

Matthijs Kwak, Kasper Hornbæk, Panos Markopoulos, and Miguel Bruns Alonso. 2014. The Design Space of Shape-changing Interfaces: A Repertory Grid Study. Proceedings of the 2014 Conference on Designing Interactive Systems, ACM, 181--190.

Digital Library

[21]

Daniel Leithinger and Hiroshi Ishii. 2010. Relief: a scalable actuated shape display. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction (TEI '10). ACM, NY, NY, USA, 221--222.

Digital Library

[22]

G. Michelitsch, J. Williams, M. Osen, B. Jimenez, and S. Rapp. 2004. Haptic chameleon: a new concept of shape-changing user interface controls with force feedback. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04). ACM, NY, NY, USA, 1305--1308.

Digital Library

[23]

Tamotsu Murakami, Kazuhiko Hayashi, Kazuhiro Oikawa, and Naomasa Nakajima. 1995. DO-IT: deformable objects as input tools. In Conference Companion on Human Factors in Computing Systems (CHI '95), I. Katz, R. Mack, and L. Marks (Eds.). ACM, NY, NY, USA, 87--88.

Digital Library

[24]

Ken Nakagaki, Sean Follmer, and Hiroshi Ishii. 2015. LineFORM: Actuated Curve Interfaces for Display, Interaction, and Constraint. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, NY, NY, USA, 333--339.

Digital Library

[25]

Ryuma Niiyama, Xu Sun, Lining Yao, Hiroshi Ishii, Daniela Rus, and Sangbae Kim. 2015. Sticky Actuator: Free-Form Planar Actuators for Animated Objects. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, NY, NY, USA, 77--84.

Digital Library

[26]

Joohee Park, Young-Woo Park, and Tek-Jin Nam. 2014. Wrigglo: shape-changing peripheral for interpersonal mobile communication. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, NY, USA, 3973--3976.

Digital Library

[27]

Ivan Poupyrev, Tatsushi Nashida, and Makoto Okabe. 2007. Actuation and tangible user interfaces: the Vaucanson duck, robots, and shape displays. In Proceedings of the 1st international conference on Tangible and embedded interaction (TEI '07). ACM, NY, NY, USA, 205--212.

Digital Library

[28]

Majken K. Rasmussen, Timothy Merritt, Miguel Bruns Alonso, and Marianne Graves Petersen. 2016. Balancing User and System Control in ShapeChanging Interfaces: a Designerly Exploration. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, NY, NY, USA, 202--210.

Digital Library

[29]

Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk. 2012. Shapechanging interfaces: a review of the design space and open research questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, NY, NY, USA, 735--744.

Digital Library

[30]

Bernd Rohrbach. 1969. "Kreativ nach Regeln -- Methode 635, eine neue Technik zum Lösen von Problemen". (Creative by rules - Method 635, a new technique for solving problems)". Absatzwirtschaft 12: 73--53.

[31]

Scott S. Snibbe, Karon E. MacLean, Rob Shaw, Jayne Roderick, William L. Verplank, and Mark Scheeff. 2001. Haptic techniques for media control. In Proceedings of the 14th annual ACM symposium on User interface software and technology (UIST '01). ACM, NY, NY, USA, 199--208.

Digital Library

[32]

Faisal Taher, John Hardy, Abhijit Karnik, et al. 2015. Exploring Interactions with Physically Dynamic Bar Charts. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 3237--3246.

Digital Library

[33]

John Tiab and Kasper Hornbæk. 2016. Understanding Affordance, System State, and Feedback in ShapeChanging Buttons. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 2752--2763.

Digital Library

[34]

Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii. 2013. PneUI: Pneumatically Actuated Soft Composite Materials for Shape Changing Interfaces. Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, ACM, 13--22.

Digital Library

Cited By

Razevicius GRoudaut AKarnik A(2024)HoberUI: An Exploration of Kinematic Structures as Interactive Input DevicesMultimodal Technologies and Interaction10.3390/mti80200138:2(13)Online publication date: 13-Feb-2024
https://doi.org/10.3390/mti8020013
Deshpande HHan BMoon KBianchi AZheng CKim J(2024)Reconfigurable Interfaces by Shape Change and Embedded MagnetsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642802(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642802
Sørensen MBertelsen ANordmark Hoffmann NPetersen MHoggan E(2022)MoLux: Negotiating Control with a Shape-Changing Lamp at HomeNordic Human-Computer Interaction Conference10.1145/3546155.3547271(1-13)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3546155.3547271
Show More Cited By

Index Terms

Button+: Supporting User and Context Aware Interaction through Shape-Changing Interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

WristOrigami: Exploring Foldable Design for Multi-Display Smartwatch
DIS '18: Proceedings of the 2018 Designing Interactive Systems Conference

We present WristOrigami, an origami-inspired design concept and system extending the interaction with smartwatches through a foldable structure with multiple on-wrist displays. The current design provides extra affordances via folding, flipping, and ...
Display button: a marriage of GUI and PUI
HCI'07: Proceedings of the 12th international conference on Human-computer interaction: interaction platforms and techniques

GUI (graphical user interface) output and PUI (physical user interface) input are two major concepts of user interface design for commercial products. GUIs and PUIs have been normally implemented on individual devices such as a screen and sets of buttons,...
Causing commotion with a shape-changing bench: experiencing shape-changing interfaces in use
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper we describe results from testing coMotion, a shape-changing bench, in three different contexts: a concert hall foyer, an airport departure hall and a shopping mall. We have gathered insights from more than 120 people, with regard to how ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '17: Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction

March 2017

806 pages

ISBN:9781450346764

DOI:10.1145/3024969

General Chairs:
Masa Inakage
Masa Inakage, Keio University, Japan
,
Hiroshi Ishii
Massachusetts Institute of Technology, USA
,
Ellen Yi-Luen Do
National University of Singapore, Singapore
,
Program Chairs:
Jürgen Steimle
Saarland University, Germany
,
Orit Shaer
Wellesley College, Massachusetts, USA
,
Kai Kunze
Keio University, Japan
,
Publications Chair:
Roshan Peiris
Keio University, Japan

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 March 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

MSIP Korea

Conference

TEI '17

Sponsor:

SIGCHI

TEI '17: Eleventh International Conference on Tangible, Embedded, and Embodied Interaction

March 20 - 23, 2017

Yokohama, Japan

Acceptance Rates

TEI '17 Paper Acceptance Rate 41 of 151 submissions, 27%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
766
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Razevicius GRoudaut AKarnik A(2024)HoberUI: An Exploration of Kinematic Structures as Interactive Input DevicesMultimodal Technologies and Interaction10.3390/mti80200138:2(13)Online publication date: 13-Feb-2024
https://doi.org/10.3390/mti8020013
Deshpande HHan BMoon KBianchi AZheng CKim J(2024)Reconfigurable Interfaces by Shape Change and Embedded MagnetsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642802(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642802
Sørensen MBertelsen ANordmark Hoffmann NPetersen MHoggan E(2022)MoLux: Negotiating Control with a Shape-Changing Lamp at HomeNordic Human-Computer Interaction Conference10.1145/3546155.3547271(1-13)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3546155.3547271
Serrano MFinch JIrani PLucero ARoudaut A(2022)Mold-It: Understanding how Physical Shapes affect Interaction with Handheld Freeform DevicesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502022(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502022
Chen ACo D(2022)Workshops in TEI: Development, Evaluation, Exploration, and ImplementationProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3505562(1-9)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3505562
van Oosterhout AHoggan EWakkary RAndersen KOdom WDesjardins APetersen M(2020)Reshaping Interaction with Rotary KnobsProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395536(1973-1982)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395536
Petersen MRasmussen MTrettvik JWakkary RAndersen KOdom WDesjardins APetersen M(2020)Affordances of Shape-Changing InterfacesProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395521(1959-1971)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395521
Kim HCoutrix CRoudaut A(2019)KnobSlider: Design of a Shape-Changing Parameter Control UI and Study of User Preferences on Its Speed and TangibilityFrontiers in Robotics and AI10.3389/frobt.2019.000796Online publication date: 29-Aug-2019
https://doi.org/10.3389/frobt.2019.00079
van Oosterhout AHoggan ERasmussen MBruns MHarrison SBardzell SNeustaedter CTatar D(2019)DynaKnobProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322321(963-974)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322321
Kim HGuimarães PCoutrix CRoudaut AHarrison SBardzell SNeustaedter CTatar D(2019)ExpanDialProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322283(949-961)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322283
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents