abstract

Physical Construction Toys for Rapid Sketching of Tangible User Interfaces

Authors:

Kristian Gohlke,

Michael Hlatky,

Bram de JongAuthors Info & Claims

TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 643 - 648

https://doi.org/10.1145/2677199.2687900

Published: 15 January 2015 Publication History

Abstract

Physical construction toys such as Lego or similar brick-based systems provide a rich space for tangible interactions. In this paper we explore their potential as a readily available prototyping platform for Tangible User Interfaces. The system enables interaction designers and users to create functional control layouts, tangible experience prototypes, custom interface elements, and grid based interactions from Lego bricks. The position, color, orientation and shape of the markerless bricks are tracked using a camera. We have conducted an initial exploration of this design space through an exemplary case study of a tangible interface for music creation: users can construct interactive interface elements such as tangible grids for the arrangement of drum-patterns and different types of continuous controllers for parameter adjustments. The system is currently a work in progress; ongoing efforts are aimed at a more thorough evaluation.

References

[1]

Akai, Y. LegoSequencer MR2. yoshiakai.com/2008/Lego%20Sequencer01.html (accessed: July 25th 2014)

[2]

Andersen, K. Using Props to Explore Design Futures: Making New Instruments. Proceedings of ACM CHI '14. ACM Press (2014).

[3]

Buchenau, M., & Fulton Suri, J. Experience prototyping. Proc. ACM DIS '00, ACM Press (2000).

Digital Library

[4]

Costanza, E., et al. Ubicomp to the masses: a largescale study of two tangible interfaces for download. Proc. ACM Ubicomp '10. ACM Press (2014).

Digital Library

[5]

Costanza, E. & Huang, J. Designable Visual Markers. Proc. ACM CHI '09. ACM Press (2009).

Digital Library

[6]

Gupta, A., et al. DuploTrack: a real-time system for authoring and guiding Duplo block assembly. Proc. UIST '12. ACM Press (2012).

Digital Library

[7]

Harrison, C., et al. TouchTools: leveraging familiarity and skill with physical tools to augment touch interaction. Proc. ACM CHI '14. ACM Press (2014).

Digital Library

[8]

Hesse, A., & McDiarmid, A. The Bubblegum Sequencer. Proc. ACM CHI 2008. ACM Press (2008). www.backin.de/gumball/ (acc.: July 25th 2014)

[9]

Homann, G., Tzschentke, D., Weidenhaupt, C. & Zentis, P. Stekgreif und an.schlag. Proc. Mensch & Computer 2008, Berlin. Logos Verlag.

[10]

Kaltenbrunner, M., & Bencina, R. reacTIVision: a computer-vision framework for table-based tangible interaction. Proc. ACM TEI '07. ACM Press (2007).

Digital Library

[11]

Kaltenbrunner, M., Tangible Music. modin.yuri.at/tangibles/ (acc.: July 25th 2014).

[12]

Lego Fusion. www.lego.com/en-us/fusion/ (acc.: July 25th 2014)

[13]

LegoTechno 2.0 Sliding Puzzle Sequencer www.youtube.com/watch?v=ei9jyGvRgvs (acc.: November 11th 2014)

[14]

Mann, Y., Lubow, J., & Freed, A. The Tactus: A Tangible, Rhythmic Grid Interface Using FoundObjects. Proc. Nime 2009.

[15]

MidiHack 2014. www.midihack.com (acc.: July 25th 2014)

[16]

Music Hack Day Barcelona 2014. new.musichackday.org/2014/barcelona/ (acc: July 25th 2014)

[17]

OpenCV. www.opencv.org (acc.: July 25th 2014)

[18]

Osmo. www.playosmo.com (acc: July 25th 2014)

[19]

Palette. www.palettegear.com (acc.: July 25th 2014)

[20]

RBMA Presents: Sushi Sequencer (Making Of) www.youtube.com/watch?v=rZFcHlXL7nk (acc.: November 11th 2014)

[21]

Rosenbaum, E., Lego Sequencer. www.youtube.com/watch?v=eL7FS8KantE (acc.: July 25th 2014)

[22]

Superquadratic Beat Bricks. www.vimeo.com/45026119 (acc.: July 25th 2014)

[23]

The Brickquencer. www.fleg.de/art/brickquencer (acc.: July 25th 2014)

[24]

The SoundMachine. www.thinkbricks.net/?p=638 (acc.: July 25th 2014).

[25]

Wagner, T. Poco Sequencer. www.thomaswagner.me/5poco.html (acc.: July 25th 2014)

[26]

Weiss, M., et al. SLAP widgets: bridging the gap between virtual and physical controls on tabletops. Proc. ACM CHI '09. ACM Press (2009).

Digital Library

Cited By

Waldhör MHödl OReichl P(2024)BrickMusicTable: A LEGO brick-based tabletop sequencerProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701592(412-418)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701592
Korsten HBaratè ALudovico L(2023)Design, Implementation, and Early Experimentation of a Music Tangible User Interface for Elderly People RehabilitationComputer-Human Interaction Research and Applications10.1007/978-3-031-41962-1_6(108-129)Online publication date: 24-Aug-2023
https://doi.org/10.1007/978-3-031-41962-1_6
Li YLiang MPreissing JBachl NDutoit MWeber TMayer SHussmann H(2022)A Meta-Analysis of Tangible Learning Studies from the TEI ConferenceProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501313(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501313
Show More Cited By

Index Terms

Physical Construction Toys for Rapid Sketching of Tangible User Interfaces
1. Applied computing
  1. Arts and humanities
    1. Sound and music computing
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection
NordiCHI '12: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design

In this paper we present the tangible 3D tabletop and discuss the design potential of this novel interface. The tangible 3D tabletop combines tangible tabletop interaction with 3D projection in such a way that the tangible objects may be augmented with ...
Prototipação de interfaces tangíveis de produtos interativos: estado da arte e desafios da plataforma arduino
IHC '12: Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems

One kind of user interface that appeared in the literature of Human-Computer Interaction (HCI) in the mid-1990s is called Tangible User Interface (TUI). TUIs are interfaces that take advantage of multiple human senses and capabilities guided by an ...
Novel interaction techniques using touch-sensitive tangibles in tabletop environments
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

In this work, we propose techniques for interaction that use a touch-sensitive tangible to assist 3D manipulation in tabletop applications. The objective of this research is to investigate the effectiveness and user satisfaction with this combination ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

January 2015

766 pages

ISBN:9781450333054

DOI:10.1145/2677199

Conference Chairs:
Bill Verplank
Stanford University, USA
,
Wendy Ju
Stanford University, USA
,
Program Chairs:
Alissa Antle
Simon Fraser University, Canada
,
Ali Mazalek
Georgia Institute of Technology, USA
,
Florian "Floyd" Mueller
RMIT, Australia

Copyright © 2015 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 January 2015

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

European Community's Seventh Framework Programme FP7/2007-2013

Conference

TEI '15

Sponsor:

SIGCHI

TEI '15: Ninth International Conference on Tangible, Embedded, and Embodied Interaction

January 15 - 19, 2015

California, Stanford, USA

Acceptance Rates

TEI '15 Paper Acceptance Rate 63 of 222 submissions, 28%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
482
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Waldhör MHödl OReichl P(2024)BrickMusicTable: A LEGO brick-based tabletop sequencerProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701592(412-418)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701592
Korsten HBaratè ALudovico L(2023)Design, Implementation, and Early Experimentation of a Music Tangible User Interface for Elderly People RehabilitationComputer-Human Interaction Research and Applications10.1007/978-3-031-41962-1_6(108-129)Online publication date: 24-Aug-2023
https://doi.org/10.1007/978-3-031-41962-1_6
Li YLiang MPreissing JBachl NDutoit MWeber TMayer SHussmann H(2022)A Meta-Analysis of Tangible Learning Studies from the TEI ConferenceProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501313(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501313
Krestanova ACerny MAugustynek M(2021)Review: Development and Technical Design of Tangible User Interfaces in Wide-Field Areas of ApplicationSensors10.3390/s2113425821:13(4258)Online publication date: 22-Jun-2021
https://doi.org/10.3390/s21134258
de Albuquerque Wheler AKelner JHung PJeronimo BRocha RAraújo A(2021)Toy user interface design—Tools for Child–Computer InteractionInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2021.10030730:COnline publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1016/j.ijcci.2021.100307
de Albuquerque Wheler AKelner JRocha Junior RNogueira T(2020)IoT4Fun rapid prototyping tools for Toy User InterfacesElectronic Commerce Research and Applications10.1016/j.elerap.2020.10100944(101009)Online publication date: Nov-2020
https://doi.org/10.1016/j.elerap.2020.101009
de Albuquerque AKelner JHung P(2020)Human-Centered Design Tools for Smart ToysInternet of Vehicles. Technologies and Services Toward Smart Cities10.1007/978-3-030-38651-1_26(327-343)Online publication date: 19-Jan-2020
https://doi.org/10.1007/978-3-030-38651-1_26
Malizia AChamberlain AWillcock I(2018)From Design Fiction to Design Fact: Developing Future User Experiences with Proto-ToolsHuman-Computer Interaction. Theories, Methods, and Human Issues10.1007/978-3-319-91238-7_14(159-168)Online publication date: 1-Jun-2018
https://doi.org/10.1007/978-3-319-91238-7_14
Bennett PFraser MBoa DHicks BInakage MIshii HDo ESteimle JShaer OKunze KPeiris R(2017)InstructiBlocksProceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3024969.3025092(551-558)Online publication date: 20-Mar-2017
https://dl.acm.org/doi/10.1145/3024969.3025092
Knees PAndersen KJorda SHlatky MGeiger GGaebele WKaurson R(2015)Giantsteps - progress towards developing intelligent and collaborative interfaces for music production and performance2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW.2015.7169826(1-4)Online publication date: Jun-2015
https://doi.org/10.1109/ICMEW.2015.7169826

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents