Article

A malleable control structure for softwired user interfaces

Authors:

Nicolas Villar,

Hans GellersenAuthors Info & Claims

TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction

Pages 49 - 56

https://doi.org/10.1145/1226969.1226980

Published: 15 February 2007 Publication History

Abstract

Rather than existing as a computer input device with a rigid shape, a predetermined selection of controls and a fixed layout, a malleable control structure is made up of a set of controls that can be freely arranged on control areas. The structure is physically adaptable by users during operation: control areas and controls can be introduced, organized and removed to suit interaction requirements and personal preference.We present an implementation of a malleable control structure called VoodooIO. Our design contributes a novel material -- the network substrate - that can be used to transform everyday surfaces into control areas, and the concept of implementing basic control units (such as buttons, sliders or dials) as ad hoc network nodes.VoodooIO does not constitute an application interface in itself. Like any input device, it only becomes concrete as an interface component in the context of a particular application. We introduce the concept of softwiring as a collection of techniques and practices that allow users to benefit from malleable control interfaces in a number of concrete scenarios of use.

References

[1]

Arduino physical computing platform. Project website: http://www.arduino.cc/

[2]

Ballagas, R., Ringer, M. Stone, M. and Borchers, J. iStuff: a physical user interface toolkit for ubiquitous computing environments. In Proc. of Human Factors in Computer Systems (CHI'03), pp. 537--544, 2003.

Digital Library

[3]

Ballagas, R., Szybalksi, A., and Fox, A. PatchPanel: Enabling Control-Flow Interoperability in Ubicomp Environments. In Proc. IEEE Int'l Conference on Pervasive Computing and Communications (PerCom'04). pp. 241. 2004.

Digital Library

[4]

Block, F., Villar, N. and Gellersen, H. A Malleable Physical Interface for Copying, Pasting, and Organizing Digital Clips. http://www.voodooio.com/

[5]

Bowers, J. and Villar, N. Creating Ad Hoc Instruments with Pin&Play&Perform. In Proc. of New Interfaces from Musical Expression (NIME'06). 2006.

Digital Library

[6]

Buxton, W. There's More to Interaction than Meets the Eye: Some Issues in Manual Input. In Norman, D. A. and Draper, S. W. (Eds.), User Centered System Design: New Perspectives on Human-Computer Interaction. Lawrence Erlbaum Assoc., Hillsdale NJ, pp. 319--339. 1986.

[7]

Brown, E. Buxton, W. and Murtagh, K. Windows on Tablets as a means of achieving virtual input devices. In Proc. of Human-Computer Interaction (INTERACT '90). Pp. 675--681. 1990.

Digital Library

[8]

Dallas/Maxim. Overview of 1-Wire Technology and Its Use. http://pdfserv.maxim-ic.com/en/an/AN1796.pdf

[9]

Ergodex DX1 Input System. Product website: http://www.ergodex.com

[10]

Greenberg, S. and Boyle, M. Customizable Physical Interfaces for Interacting with Conventional Applications. In Proc. of UIST '02. pp. 31--40. 2002.

Digital Library

[11]

Greenberg, S and Fitchett, C. Phidgets: easy development of physical interfaces through physical widgets. Proc. UIST '01, ACM Press (2001), 209--218.

Digital Library

[12]

Fitzmaurice, G., Ishii, H. and Buxton, W. Bricks: Laying the Foundations for Graspable User Interfaces. In Proc. of the Conference on Human Factors in Computer Systems (CHI'95). pp. 442--449. 1995.

Digital Library

[13]

Ishii, H., and B. Ullmer. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proc. of Human Factors in Computer Systems (CHI'97), pp. 234--241, 1997.

Digital Library

[14]

Kobayashi, S. and Akamatsu, M. Spinner: a simple approach to reconfigurable user interfaces. In Proc. of New Interfaces for Musical Expression (NIME'05). pp. 208--211. 2005.

Digital Library

[15]

Kobayashi, S., Endo, T., Harada, K. and Oishi, S. GAINER: a reconfigurable I/O module and software libraries for education. In Proc. New Interfaces for Musical Expression (NIME'06). pp. 346--351.

Digital Library

[16]

Kimura, H. Tokunaga, Tokunaga, E., Okuda, Y. Nakajima, T. CookieFlavours: Easy Buildings Blocks for Wireless Tangible Input. In Proc. of Human Factors in Computer Systems (CHI'06). pp. 965--970. 2006.

Digital Library

[17]

Lee, J. C., Avrahami, D., Hudson, S. E., Forlizzi, J., Dietz, P. H., and Leigh, D. The calder toolkit: wired and wireless components for rapidly prototyping interactive devices. In Proc. DIS '04: Designing Interactive Systems. pp. 167--175. 2004.

Digital Library

[18]

Lifton, J., Seetharam, D., Broxton, M., and Paradiso, J. A. Pushpin computing system overview: A platform for distributed, embedded, ubiquitous sensor networks. In Proc. Pervasive '02. pp. 139--151. 2002.

Digital Library

[19]

Nakatani, L. H. and Rohrlich, J. A. Soft Machines: A Philosophy of User-Computer Interface Design. In Proc. of Human Factors in Computer Systems (CHI'83). 1983.

Digital Library

[20]

Patten, J. and Ishii, H. A Comparison of Spatial Organization Strategies in Graphical and Tangible User Interfaces. In Proc of Designing augmented reality environments (DARE'00). pp. 41--50. 2000.

Digital Library

[21]

Pedersen, E. Sokoler, T. Nelson L. PaperButtons: expanding a tangible user interface. In Proc. of Designing interactive systems (DIS'00). pp. 216--223. 2000.

Digital Library

[22]

Scott, J., Hoffmann, F., Addlesee, M., Mapp, G., and Hopper, A. Networked surfaces: a new concept in mobile networking. In Mobile Networks and Applications. 7(5):353--364. 2002.

Digital Library

[23]

Ungvary, T. and Vertegaal, R. The SensOrg: A Musical Cyberinstrument with a Cognitive Ergonomical Touch. In Proc. of IEEE SMC'98 Interntational Conference on Systems, Man and Cybernetics. 1998.

[24]

Van Laerhoven, K. Villar, N. Schmidt, A., Gellersen, H., Håkansson, M. and Holmquist L. E. Pin&Play: The Surface as Network Medium. In IEEE Communications Magazine, April 2003, Vol.41 No.4. pp. 90--96. 2003.

Digital Library

[25]

Villar, N., Gilleade K., Raymundy-Ellis, D. and Gellersen, H. The VoodooIO Gaming Kit: A Real-Time Adaptable Gaming Controller. In Proc. of ACM Advances in Computer Entertainment (ACE '06). 2006.

Digital Library

[26]

Villar, N., and Gellersen, H. The Friday Afternoon Project: A VoodooIO Prototyping Exercise. In Proc. of Mobile and Embedded Interactive Systems Workshop (MEIS'06). 2006.

[27]

Villar, N., Linsday, and Gellersen, H. A rearrangeable tangible interface for musical composition and performance. In Proc. of New Interfaces for Musical Expression (NIME'05). 2005.

Digital Library

[28]

VoodooIO Project Website: http://www.voodooio.com

[29]

Hartmann, B., Klemmer, S. R., Bernstein, M., and Mehta, N. d. tools: Visually Prototyping Physical UIs through Statecharts. In Extended Abstracts of UIST 2005, October 23--26, 2005.

Cited By

Buch NTejada CAshbrook DSavage V(2024)LaCir: A multilayered laser-cuttable material to co-fabricate circuitry and structural components.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642888(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642888
Lambrichts MRamakers RHodges SCoppers SDevine J(2021)A Survey and Taxonomy of Electronics Toolkits for Interactive and Ubiquitous Device PrototypingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34635235:2(1-24)Online publication date: 24-Jun-2021
https://dl.acm.org/doi/10.1145/3463523
Han CMatsui KNaemura Tvan den Hoven ELoke LShaer Ovan Dijk JKun A(2020)ForceStampsProceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3374920.3374924(273-285)Online publication date: 9-Feb-2020
https://dl.acm.org/doi/10.1145/3374920.3374924
Show More Cited By

Index Terms

A malleable control structure for softwired user interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Recommendations

Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices
UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology

Malleable and organic user interfaces have the potential to enable radically new forms of interactions and expressiveness through flexible, free-form and computationally controlled shapes and displays. This work, specifically focuses on particle jamming ...
Balancing User and System Control in Shape-Changing Interfaces: a Designerly Exploration
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

Despite an increasing number of examples of shape-changing interfaces, the relation between users' actions and product movements has not gained a great deal of attention, nor been very well articulated. This paper presents a framework articulating the ...
Hybrid control structure for multi-robot formation
ICANN'10: Proceedings of the 20th international conference on Artificial neural networks: Part II

In this paper a hybrid control structure to control a multi-robot formation is proposed. The hybrid control structure consists of two control levels: the discrete control level and the continuous control level. The discrete control level ensures the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction

February 2007

296 pages

ISBN:9781595936196

DOI:10.1145/1226969

Conference Chairs:
Brygg Ullmer
Louisiana State University, Baton Rouge, Louisiana
,
Albrecht Schmidt
Ludwig-Maximilians-University, Munich, Germany

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

CCT: LSU Center for Computation and Technology

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 February 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

TEI07

Sponsor:

CCT

TEI07: Tangible and Embedded Interaction 2007

February 15 - 17, 2007

Louisiana, Baton Rouge

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
866
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)2

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Buch NTejada CAshbrook DSavage V(2024)LaCir: A multilayered laser-cuttable material to co-fabricate circuitry and structural components.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642888(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642888
Lambrichts MRamakers RHodges SCoppers SDevine J(2021)A Survey and Taxonomy of Electronics Toolkits for Interactive and Ubiquitous Device PrototypingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34635235:2(1-24)Online publication date: 24-Jun-2021
https://dl.acm.org/doi/10.1145/3463523
Han CMatsui KNaemura Tvan den Hoven ELoke LShaer Ovan Dijk JKun A(2020)ForceStampsProceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3374920.3374924(273-285)Online publication date: 9-Feb-2020
https://dl.acm.org/doi/10.1145/3374920.3374924
Han CTakahashi RYahagi YNaemura TBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)PneuModule: Using Inflatable Pin Arrays for Reconfigurable Physical Controls on Pressure-Sensitive Touch SurfacesExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3383135(1-4)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3383135
Han CTakahashi RYahagi YNaemura TBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)PneuModule: Using Inflatable Pin Arrays for Reconfigurable Physical Controls on Pressure-Sensitive Touch SurfacesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376838(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376838
Dix AGill S(2018)Physical Computing | When Digital Systems Meet the Real WorldNew Directions in Third Wave Human-Computer Interaction: Volume 1 - Technologies10.1007/978-3-319-73356-2_8(123-144)Online publication date: 3-Jul-2018
https://doi.org/10.1007/978-3-319-73356-2_8
Gianni FMora SDivitini M(2018)Rapid Prototyping Internet of Things Applications for Augmented Objects: The Tiles Toolkit ApproachAmbient Intelligence10.1007/978-3-030-03062-9_16(204-220)Online publication date: 18-Oct-2018
https://doi.org/10.1007/978-3-030-03062-9_16
Zhang TYi XYu CWang YBecker NShi Y(2017)TouchPowerProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/31309861:3(1-20)Online publication date: 11-Sep-2017
https://dl.acm.org/doi/10.1145/3130986
Clarke CGellersen HGajos KMankoff JHarrison C(2017)MatchPointProceedings of the 30th Annual ACM Symposium on User Interface Software and Technology10.1145/3126594.3126626(179-192)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3126594.3126626
Teyssier MBailly GLecolinet ÉMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)VersaPenProceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/3027063.3053159(2155-2163)Online publication date: 6-May-2017
https://dl.acm.org/doi/10.1145/3027063.3053159
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents