research-article

Modular Tangible User Interfaces: Impact of Module Shape and Bonding Strength on Interaction

Authors:

Julien Bourgeois,

Yann Laurillau,

Céline CoutrixAuthors Info & Claims

TEI '23: Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

Article No.: 1, Pages 1 - 15

https://doi.org/10.1145/3569009.3572731

Published: 26 February 2023 Publication History

Abstract

Modular Tangible User Interfaces (TUIs) –i.e., UIs made of small-scale physical modules– offer novel opportunities for tangible interaction thanks to their highly customizable form factor. Such modular TUIs were proposed with different shape of modules and bonding strength between them. The problem we address in this paper is the lack of knowledge of how bonding strength and shape of the modules impact usability. We present the first study exploring the impact of bonding strength and module shape on subjective user ratings when interacting with a magnetic modular prototype. We assessed three levels of bonding strength (low, mid, high) and two shapes (cubes and rounded cubes) in a controlled user study. Participants performed eight common manipulations found in the literature for (non-)modular TUIs. Experimental results showed that (1) cubic modules are overall easier and more satisfying to manipulate, except for precision and bending tasks, (2) low strength impairs UI solidity, but high strength impairs precision tasks with cubic modules.

Supplementary Material

Experimental data (.csv) and analysis script (.Rmd) (tei23_7_supplementary.zip)

Download
29.68 KB

References

[1]

2020. Magnet Sets - ASTM F3458-21. https://www.cpsc.gov/Regulations-Laws–Standards/Voluntary-Standards/Topics/Magnet-Sets.

[2]

2020. The Toy Association Statement on Magnets in Toys. https://www.toyassociation.org/PressRoom2/IndustryStatements/ToySafety/statement-on-magnets.aspx.

[3]

2022. Connex3 Objet500 and Objet350.https://www.stratasys.com/3d-printers/objet-350-500-connex3.

[4]

2022. HKCM Engineering e.K. professional magnet supplier.https://www.hkcm.de/.

[5]

2022. Safety Standard for Magnets. https://www.federalregister.gov/documents/2022/01/10/2021-27826/safety-standard-for-magnets.

[6]

2022. Video recordings of "Modular Tangible User Interfaces: Impact of Module Shape and Bonding Strength on Interaction". https://doi.org/10.5281/zenodo.7372398.

[7]

Alexander T. Adams, Elizabeth L. Murnane, Phil Adams, Michael Elfenbein, Pamara F. Chang, Shruti Sannon, Geri Gay, and Tanzeem Choudhury. 2018. Keppi: A Tangible User Interface for Self-Reporting Pain. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–13. https://doi.org/10.1145/3173574.3174076

Digital Library

[8]

David Ahlström, Khalad Hasan, and Pourang Irani. 2014. Are you comfortable doing that?: acceptance studies of around-device gestures in and for public settings. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services - MobileHCI ’14. ACM Press, Toronto, ON, Canada, 193–202. https://doi.org/10.1145/2628363.2628381

Digital Library

[9]

Teemu T. Ahmaniemi, Johan Kildal, and Merja Haveri. 2014. What is a device bend gesture really good for?. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto Ontario Canada, 2014-04-26). ACM, 3503–3512. https://doi.org/10.1145/2556288.2557306

Digital Library

[10]

Jason Alexander, Anne Roudaut, Jürgen Steimle, Kasper Hornbæk, Miguel Bruns Alonso, Sean Follmer, and Timothy Merritt. 2018. Grand Challenges in Shape-Changing Interface Research. In the CHI 2018 Conference. New York, New York, USA, 1–14. https://doi.org/10.1145/3173574.3173873

Digital Library

[11]

Lonni Besançon, Mehdi Ammi, and Tobias Isenberg. 2017. Pressure-Based Gain Factor Control for Mobile 3D Interaction using Locally-Coupled Devices. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver Colorado USA, 2017-05-02). ACM, 1831–1842. https://doi.org/10.1145/3025453.3025890

Digital Library

[12]

Julien Bourgeois, Benoît Piranda, André Naz, Nicolas Boillot, Hakim Mabed, Dominique Dhoutaut, Thadeu Tucci, and Hicham Lakhlef. 2016. Programmable matter as a cyber-physical conjugation.SMC (2016). https://dblp.org/rec/conf/smc/BourgeoisPNBMDT16

[13]

Eric Brockmeyer, Ivan Poupyrev, and Scott Hudson. 2013. PAPILLON: designing curved display surfaces with printed optics. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, St. Andrews Scotland, United Kingdom, 457–462. https://doi.org/10.1145/2501988.2502027

Digital Library

[14]

T.W. Calvert and A.E. Chapman. 1977. The relationship between the surface EMG and force transients in muscle: Simulation and experimental studies. 65, 5 (1977), 682–689. https://doi.org/10.1109/PROC.1977.10547

[15]

Baptiste Caramiaux, Marco Donnarumma, and Atau Tanaka. 2015. Understanding Gesture Expressivity through Muscle Sensing. ACM Transactions on Computer-Human Interaction 21, 6 (Jan. 2015), 31:1–31:26. https://doi.org/10.1145/2687922 Number: 6.

Digital Library

[16]

Liwei Chan, Stefanie Müller, Anne Roudaut, and Patrick Baudisch. 2012. CapStones and ZebraWidgets: sensing stacks of building blocks, dials and sliders on capacitive touch screens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Austin Texas USA, 2189–2192. https://doi.org/10.1145/2207676.2208371

Digital Library

[17]

Lung-Pan Cheng, Thijs Roumen, Hannes Rantzsch, Sven Köhler, Patrick Schmidt, Robert Kovacs, Johannes Jasper, Jonas Kemper, and Patrick Baudisch. 2015. TurkDeck: Physical Virtual Reality Based on People. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte NC USA, 2015-11-05). ACM, 417–426. https://doi.org/10.1145/2807442.2807463

Digital Library

[18]

Jay Davey, Ngai Kwok, and Mark Yim. 2012. Emulating self-reconfigurable robots - design of the SMORES system. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, Vilamoura-Algarve, Portugal, 4464–4469. https://doi.org/10.1109/IROS.2012.6385845

[19]

Jay Davey, Jimmy Sastra, Matt Piccoli, and Mark Yim. 2012. ModLock: A manual connector for reconfigurable modular robots. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. 3217–3222. https://doi.org/10.1109/IROS.2012.6386190 ISSN: 2153-0866.

[20]

Gary R. VandenBos (Ed.). 2009. Publication Manual of the American Psychological Association (6th ed.). http://www.apastyle.org/manual/

[21]

Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: dynamic physical affordances and constraints through shape and object actuation. In UIST ’13: Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, New York, New York, USA, 417–426. https://doi.org/10.1145/2501988.2502032

Digital Library

[22]

Bruno Fruchard. 2021. Squish This: Force Input on Soft Surfacesfor Visual Targeting Tasks. (2021), 9.

[23]

Toshio Fukuda’ and Yoshio Kawauchi. 1990. Cellular Robotic System(CEB0T) as One of the Realization of Self-organizing Intelligent Universal Manipulator. 6.

[24]

Kyle Gilpin, Ara Knaian, and Daniela Rus. 2010. Robot pebbles: One centimeter modules for programmable matter through self-disassembly. In 2010 IEEE International Conference on Robotics and Automation. IEEE, Anchorage, AK, 2485–2492. https://doi.org/10.1109/ROBOT.2010.5509817

[25]

Kyle Gilpin, Keith Kotay, Daniela Rus, and Iuliu Vasilescu. 2008. Miche: Modular Shape Formation by Self-Disassembly. The International Journal of Robotics Research 27, 3-4 (March 2008), 345–372. https://doi.org/10.1177/0278364907085557 Number: 3-4.

Digital Library

[26]

Alix Goguey, Timothy Neate, Jennifer Pearson, Simon Robinson, Matt Jones, Cameron Steer, Andrés Lucero, Laurence Nigay, Deepak Ranjan Sahoo, Céline Coutrix, Anne Roudaut, Sriram Subramanian, and Yutaka Tokuda. 2019. PickCells: A Physically Reconfigurable Cell-composed Touchscreen. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, Glasgow, Scotland Uk, 1–14. https://doi.org/10.1145/3290605.3300503

Digital Library

[27]

Antonio Gomes, Andrea Nesbitt, and Roel Vertegaal. 2013. MorePhone: a study of actuated shape deformations for flexible thin-film smartphone notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Paris France, 583–592. https://doi.org/10.1145/2470654.2470737

Digital Library

[28]

Antonio Gomes, Lahiru Lakmal Priyadarshana, Aaron Visser, Juan Pablo Carrascal, and Roel Vertegaal. 2018. Magicscroll: a rollable display device with flexible screen real estate and gestural input. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, Barcelona Spain, 1–11. https://doi.org/10.1145/3229434.3229442

Digital Library

[29]

[29] The LEGO group.2021. https://www.lego.com/en-us/lego-history/the-stud-and-tube-principle-001aa762568348239d659d4ffdc2dfe3

[30]

Hongri Gu, Quentin Boehler, Daniel Ahmed, and Bradley J. Nelson. 2019. Magnetic quadrupole assemblies with arbitrary shapes and magnetizations. Science Robotics 4, 35 (Oct. 2019), eaax8977. https://doi.org/10.1126/scirobotics.aax8977

[31]

Simon Hauser, Mehmet Mutlu, and Auke J. Ijspeert. 2020. Kubits: Solid-State Self-Reconfiguration With Programmable Magnets. 5, 4 (2020), 6443–6450. https://doi.org/10.1109/LRA.2020.3013884

[32]

Oren Horev. 2006. Talking to the hand: An exploration into shape shifting objects and morphing interfaces. Master’s thesis. Interaction Design Institute Ivrea.

[33]

Sungjae Hwang, Myungwook Ahn, and Kwang-yun Wohn. 2013. MagGetz: customizable passive tangible controllers on and around conventional mobile devices. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, St. Andrews Scotland, United Kingdom, 411–416. https://doi.org/10.1145/2501988.2501991

Digital Library

[34]

Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: beyond tangible bits, toward transformable materials. Interactions 19, 1 (Jan. 2012), 38–51. https://doi.org/10.1145/2065327.2065337

Digital Library

[35]

Sungjune Jang, Lawrence H. Kim, Kesler Tanner, Hiroshi Ishii, and Sean Follmer. 2016. Haptic Edge Display for Mobile Tactile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). Association for Computing Machinery, New York, NY, USA, 3706–3716. https://doi.org/10.1145/2858036.2858264

Digital Library

[36]

M. E. Karagozler, J. D. Campbell, G. K. Fedder, S. C. Goldstein, M. P. Weller, and B. W. Yoon. 2007. Electrostatic latching for inter-module adhesion, power transfer, and communication in modular robots. In 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2779–2786. https://doi.org/10.1109/IROS.2007.4399492 ISSN: 2153-0866.

[37]

Elio Keddisseh, Marcos Serrano, and Emmanuel Dubois. 2021. KeyTch: Combining the Keyboard with a Touchscreen for Rapid Command Selection on Toolbars. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama Japan, 2021-05-06). ACM, 1–13. https://doi.org/10.1145/3411764.3445288

Digital Library

[38]

Hyunyoung Kim, Celine Coutrix, and Anne Roudaut. 2018. Morphees+: Studying Everyday Reconfigurable Objects for the Design and Taxonomy of Reconfigurable UIs. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–14. https://doi.org/10.1145/3173574.3174193

Digital Library

[39]

Brian T. Kirby, Michael Ashley-Rollman, and Seth Copen Goldstein. 2011. Blinky blocks: a physical ensemble programming platform. In Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems - CHI EA ’11. ACM Press, Vancouver, BC, Canada, 1111. https://doi.org/10.1145/1979742.1979712

Digital Library

[40]

Martin Krzywinski and Naomi Altman. 2013. Error bars. 10, 10 (2013), 921–922. https://doi.org/10.1038/nmeth.2659

[41]

Caitlin Kuhlman, Diana Doherty, Malika Nurbekova, Goutham Deva, Zarni Phyo, Paul-Henry Schoenhagen, MaryAnn VanValkenburg, Elke Rundensteiner, and Lane Harrison. 2019. Evaluating Preference Collection Methods for Interactive Ranking Analytics. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow Scotland Uk, 2019-05-02). ACM, 1–11. https://doi.org/10.1145/3290605.3300742

Digital Library

[42]

Mathieu Le Goc, Pierre Dragicevic, Samuel Huron, Jeremy Boy, and Jean-Daniel Fekete. 2016. A Better Grasp on Pictures Under Glass: Comparing Touch and Tangible Object Manipulation using Physical Proxies. In Proceedings of the International Working Conference on Advanced Visual Interfaces. ACM, Bari Italy, 76–83. https://doi.org/10.1145/2909132.2909247

Digital Library

[43]

Mathieu Le Goc, Lawrence H Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building Blocks for Swarm User Interfaces. In UIST’16. 1–13. https://doi.org/10.1145/2984511.2984547

Digital Library

[44]

Yujin Lee, Myeongseong Kim, and Hyunjung Kim. 2020. Rolling Pixels: Robotic Steinmetz Solids for Creating Physical Animations. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (New York, NY, USA, 2020-02-09) (TEI ’20). Association for Computing Machinery, 557–564. https://doi.org/10.1145/3374920.3374987

Digital Library

[45]

Rong-Hao Liang. 2014. GaussBricks: Magnetic Building Blocks for Constructive Tangible Interactions on Portable Displays. (2014), 9.

[46]

David Merrill, Jeevan Kalanithi, and Pattie Maes. 2007. Siftables: towards sensor network user interfaces. In Proceedings of the 1st international conference on Tangible and embedded interaction - TEI ’07. ACM Press, Baton Rouge, Louisiana, 75. https://doi.org/10.1145/1226969.1226984

Digital Library

[47]

David Merrill, Emily Sun, and Jeevan Kalanithi. 2012. Sifteo Cubes. In CHI ’12 Extended Abstracts on Human Factors in Computing Systems (Austin, Texas, USA) (CHI EA ’12). Association for Computing Machinery, New York, NY, USA, 1015–1018. https://doi.org/10.1145/2212776.2212374

Digital Library

[48]

Kei Misumi, Gwenn Ulliac, Naoto Usami, Benoit Piranda, Yoshio Mita, Akio Higo, and Julien Bourgeois. 2020. Micro-scale Electrostatic Attach-detach Device for Self-reconfigurable Modular Robotic System. In 2020 Symposium on Design, Test, Integration Packaging of MEMS and MOEMS (DTIP). 1–4. https://doi.org/10.1109/DTIP51112.2020.9139129

[49]

Pranathi Mylavarapu, Adil Yalcin, Xan Gregg, and Niklas Elmqvist. 2019. Ranked-List Visualization: A Graphical Perception Study. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow Scotland Uk, 2019-05-02). ACM, 1–12. https://doi.org/10.1145/3290605.3300422

Digital Library

[50]

Ken Nakagaki, Artem Dementyev, Sean Follmer, Joseph A. Paradiso, and Hiroshi Ishii. 2016. ChainFORM: A Linear Integrated Modular Hardware System for Shape Changing Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan, 2016-10-16) (UIST ’16). Association for Computing Machinery, 87–96. https://doi.org/10.1145/2984511.2984587

Digital Library

[51]

Ken Nakagaki, Sean Follmer, and Hiroshi Ishii. 2015. LineFORM: Actuated Curve Interfaces for Display, Interaction, and Constraint. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST ’15 (Daegu, Kyungpook, Republic of Korea, 2015). ACM Press, 333–339. https://doi.org/10.1145/2807442.2807452

Digital Library

[52]

Jonas Neubert and Hod Lipson. 2016. Soldercubes: a self-soldering self-reconfiguring modular robot system. Autonomous Robots 40, 1 (Jan. 2016), 139–158. https://doi.org/10.1007/s10514-015-9441-4

Digital Library

[53]

Martin Nisser, Leon Cheng, Yashaswini Makaram, Ryo Suzuki, and Stefanie Mueller. 2021. Programmable Polarities: Actuating Interactive Prototypes with Programmable Electromagnets. In The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event USA, 2021-10-10). ACM, 121–123. https://doi.org/10.1145/3474349.3480198

Digital Library

[54]

Chris North, Tim Dwyer, Bongshin Lee, Danyel Fisher, Petra Isenberg, George Robertson, and Kori Inkpen. 2009. Understanding Multi-touch Manipulation for Surface Computing. In Human-Computer Interaction – INTERACT 2009, Tom Gross, Jan Gulliksen, Paula Kotzé, Lars Oestreicher, Philippe Palanque, Raquel Oliveira Prates, and Marco Winckler (Eds.). Vol. 5727. Springer Berlin Heidelberg, Berlin, Heidelberg, 236–249. https://doi.org/10.1007/978-3-642-03658-3_31 Series Title: Lecture Notes in Computer Science.

Digital Library

[55]

Michael Ortega and Alix Goguey. 2019. BEXHI: A Mechanical Structure for Prototyping Bendable and EXpandable Handheld Interfaces. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces. ACM, Daejeon Republic of Korea, 269–273. https://doi.org/10.1145/3343055.3359703

Digital Library

[56]

Esben Hallundbæk Østergaard, Kristian Kassow, Richard Beck, and Henrik Hautop Lund. 2006. Design of the ATRON lattice-based self-reconfigurable robot. Autonomous Robots 21, 2 (01 Sep 2006), 165–183. https://doi.org/10.1007/s10514-006-8546-1

Digital Library

[57]

Rizuwana Parween, Anh Vu Le, Yuyao Shi, and Mohan Rajesh Elara. 2020. System Level Modeling and Control Design of hTetrakis–A Polyiamond Inspired Self-Reconfigurable Floor Tiling Robot. IEEE Access 8(2020), 88177–88187. https://doi.org/10.1109/ACCESS.2020.2992333 Conference Name: IEEE Access.

[58]

Florian Perteneder, Kathrin Probst, Joanne Leong, Sebastian Gassler, Christian Rendl, Patrick Parzer, Katharina Fluch, Sophie Gahleitner, Sean Follmer, Hideki Koike, and Michael Haller. 2020. Foxels: Build Your Own Smart Furniture. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (New York, NY, USA, 2020-02-09) (TEI ’20). Association for Computing Machinery, 111–122. https://doi.org/10.1145/3374920.3374935

Digital Library

[59]

Benoit Piranda and Julien Bourgeois. 2018. Designing a quasi-spherical module for a huge modular robot to create programmable matter. (2018), 16.

[60]

Benoît Piranda and Julien Bourgeois. 2022. Datom: A Deformable Modular Robot for Building Self-reconfigurable Programmable Matter. In Distributed Autonomous Robotic Systems, Fumitoshi Matsuno, Shun-ichi Azuma, and Masahito Yamamoto (Eds.). Springer International Publishing, Cham, 70–81.

[61]

Halley P Profita, James Clawson, Scott Gilliland, Clint Zeagler, Thad Starner, Jim Budd, and Ellen Yi-Luen Do. 2013. Don’t mind me touching my wrist: a case study of interacting with on-body technology in public. (2013), 8.

[62]

Laura Pruszko, Céline Coutrix, Yann Laurillau, Benoît Piranda, and Julien Bourgeois. 2021. Molecular HCI: Structuring the Cross-disciplinary Space of Modular Shape-changing User Interfaces. Proceedings of the ACM on Human-Computer Interaction 5, EICS (May 2021), 1–33. https://doi.org/10.1145/3461733

Digital Library

[63]

Laura Pruszko, Yann Laurillau, Benoît Piranda, Julien Bourgeois, and Céline Coutrix. 2021. Impact of the Size of Modules on Target Acquisition and Pursuit for Future Modular Shape-changing Physical User Interfaces. In Proceedings of the 2021 International Conference on Multimodal Interaction (New York, NY, USA, 2021-10-18) (ICMI ’21). Association for Computing Machinery, 297–307. https://doi.org/10.1145/3462244.3479936

Digital Library

[64]

Raf Ramakers, Johannes Schöning, and Kris Luyten. 2014. Paddle: highly deformable mobile devices with physical controls. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Toronto Ontario Canada, 2569–2578. https://doi.org/10.1145/2556288.2557340

Digital Library

[65]

Julie Rico and Stephen Brewster. 2010. Usable gestures for mobile interfaces: evaluating social acceptability. (2010), 10.

[66]

John W. Romanishin, Kyle Gilpin, Sebastian Claici, and Daniela Rus. 2015. 3D M-Blocks: Self-reconfiguring robots capable of locomotion via pivoting in three dimensions. In 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, Seattle, WA, USA, 1925–1932. https://doi.org/10.1109/ICRA.2015.7139450

[67]

John W. Romanishin, Kyle Gilpin, and Daniela Rus. 2013. M-blocks: Momentum-driven, magnetic modular robots. In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, Tokyo, 4288–4295. https://doi.org/10.1109/IROS.2013.6696971

[68]

Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: toward high "shape resolution" in self-actuated flexible mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ’13 (Paris, France, 2013). ACM Press, 593. https://doi.org/10.1145/2470654.2470738

Digital Library

[69]

A. Roudaut, D. Krusteva, M. McCoy, A. Karnik, K Ramani, and S. Subramanian. 2016. Cubimorph: Designing modular interactive devices. In 2016 IEEE International Conference on Robotics and Automation (ICRA). IEEE, Stockholm, Sweden, 3339–3345. https://doi.org/10.1109/ICRA.2016.7487508

Digital Library

[70]

Philipp Schoessler, Daniel Windham, Daniel Leithinger, Sean Follmer, and Hiroshi Ishii. 2015. Kinetic Blocks: Actuated Constructive Assembly for Interaction and Display. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology(UIST ’15). Association for Computing Machinery, New York, NY, USA, 341–349. https://doi.org/10.1145/2807442.2807453

Digital Library

[71]

Florine Simon, Anne Roudaut, Pourang Irani, and Marcos Serrano. 2019. Finding Information on Non-Rectangular Interfaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow Scotland Uk, 2019-05-02). ACM, 1–8. https://doi.org/10.1145/3290605.3300332

Digital Library

[72]

A. Spröwitz, R. Moeckel, M. Vespignani, S. Bonardi, and A.J. Ijspeert. 2014. Roombots: A hardware perspective on 3D self-reconfiguration and locomotion with a homogeneous modular robot. Robotics and Autonomous Systems 62, 7 (July 2014), 1016–1033. https://doi.org/10.1016/j.robot.2013.08.011

[73]

Paul Strohmeier, Jesse Burstyn, Juan Pablo Carrascal, Vincent Levesque, and Roel Vertegaal. 2016. ReFlex: A Flexible Smartphone with Active Haptic Feedback for Bend Input. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’16 (Eindhoven, Netherlands, 2016). ACM Press, 185–192. https://doi.org/10.1145/2839462.2839494

Digital Library

[74]

L.R. Sudhakar, R.W. Schoenmarklin, S.A. Lavender, and W.S. Marras. 1988. The Effects of Gloves on Grip Strength and Muscle Activity. Proceedings of the Human Factors Society Annual Meeting 32, 11 (Oct. 1988), 647–650. https://doi.org/10.1518/107118188786762603

[75]

Ryo Suzuki, Junichi Yamaoka, Daniel Leithinger, Tom Yeh, Mark D. Gross, Yoshihiro Kawahara, and Yasuaki Kakehi. 2018. Dynablock: Dynamic 3D Printing for Instant and Reconstructable Shape Formation. In The 31st Annual ACM Symposium on User Interface Software and Technology - UIST ’18. ACM Press, Berlin, Germany, 99–111. https://doi.org/10.1145/3242587.3242659

Digital Library

[76]

Ryo Suzuki, Clement Zheng, Yasuaki Kakehi, Tom Yeh, Ellen Yi-Luen Do, Mark D. Gross, and Daniel Leithinger. 2019. ShapeBots: Shape-changing Swarm Robots. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology(UIST ’19). Association for Computing Machinery, New York, NY, USA, 493–505. https://doi.org/10.1145/3332165.3347911

Digital Library

[77]

Atau Tanaka and R. Benjamin Knapp. 2017. 2002: Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing. In A NIME Reader, Alexander Refsum Jensenius and Michael J. Lyons (Eds.). Vol. 3. Springer International Publishing, Cham, 45–58. https://doi.org/10.1007/978-3-319-47214-0_4 Series Title: Current Research in Systematic Musicology.

[78]

Atau Tanaka and R. Benjamin Knapp. 2017. 2002: Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing. In A NIME Reader, Alexander Refsum Jensenius and Michael J. Lyons (Eds.). Vol. 3. Springer International Publishing, Cham, 45–58. https://doi.org/10.1007/978-3-319-47214-0_4 Series Title: Current Research in Systematic Musicology.

[79]

Melanie Tory and Robert Kincaid. 2013. Comparing physical, overlay, and touch screen parameter controls. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces - ITS ’13 (St. Andrews, Scotland, United Kingdom, 2013). ACM Press, 91–100. https://doi.org/10.1145/2512349.2512812

Digital Library

[80]

Philip Tuddenham, David Kirk, and Shahram Izadi. 2010. Graspables revisited: multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks. In Proceedings of the 28th international conference on Human factors in computing systems - CHI ’10 (Atlanta, Georgia, USA, 2010). ACM Press, 2223. https://doi.org/10.1145/1753326.1753662

Digital Library

[81]

Benjamin Verdier, Sheldon Andrews, and Paul G. Kry. 2017. Human grasping interaction capture and analysis. In Proceedings of the ACM SIGGRAPH / Eurographics Symposium on Computer Animation(SCA ’17). Association for Computing Machinery, New York, NY, USA, 1–2. https://doi.org/10.1145/3099564.3108163

Digital Library

[82]

Ryoichi Watanabe, Yuichi Itoh, Masatsugu Asai, Yoshifumi Kitamura, Fumio Kishino, and Hideo Kikuchi. 2004. The Soul of ActiveCube — Implementing a Flexible, Multimodal, Three-Dimensional Spatial Tangible Interface. 2, 4 (2004), 13.

[83]

Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii. 2013. PneUI: pneumatically actuated soft composite materials for shape changing interfaces. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST ’13. ACM Press, St. Andrews, Scotland, United Kingdom, 13–22. https://doi.org/10.1145/2501988.2502037

Digital Library

[84]

Kentaro Yasu. 2020. MagneLayer: Force Field Fabrication for Rapid Prototyping of Haptic Interactions. In ACM SIGGRAPH 2020 Labs. ACM, Virtual Event USA, 1–2. https://doi.org/10.1145/3388763.3407761

Digital Library

[85]

Kentaro Yasu and Yuichiro Katsumoto. 2015. Bump ahead: easy-to-design haptic surface using magnet array. In SIGGRAPH Asia 2015 Emerging Technologies. ACM, Kobe Japan, 1–3. https://doi.org/10.1145/2818466.2818478

Digital Library

[86]

Yiwei Zhao, Lawrence H. Kim, Ye Wang, Mathieu Le Goc, and Sean Follmer. 2017. Robotic Assembly of Haptic Proxy Objects for Tangible Interaction and Virtual Reality. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. ACM, Brighton United Kingdom, 82–91. https://doi.org/10.1145/3132272.3134143

Digital Library

[87]

Clement Zheng, Jeeeun Kim, Daniel Leithinger, Mark D. Gross, and Ellen Yi-Luen Do. 2019. Mechamagnets: Designing and Fabricating Haptic and Functional Physical Inputs with Embedded Magnets. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, Tempe Arizona USA, 325–334. https://doi.org/10.1145/3294109.3295622

Digital Library

[88]

Kening Zhu, Morten Fjeld, and Ayça Ünlüer. 2018. WristOrigami: Exploring Foldable Design for Multi-Display Smartwatch. In Proceedings of the 2018 on Designing Interactive Systems Conference 2018 - DIS ’18. ACM Press, Hong Kong, China, 1207–1218. https://doi.org/10.1145/3196709.3196713

Digital Library

[89]

Oren Zuckerman, Saeed Arida, and Mitchel Resnick. 2005. Extending Tangible Interfaces for Education: Digital Montessori-inspired Manipulatives. (2005), 10.

Cited By

Dominiak JWalczak AStefanidi EAdamkiewicz KGrudzień KNiess JWoźniak P(2024)ProtoBricks: A Research Toolkit for Tangible Prototyping & Data PhysicalizationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661573(476-495)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661573
Yaacoub JNoura HPiranda B(2023)The internet of modular robotic things: Issues, limitations, challenges, & solutionsInternet of Things10.1016/j.iot.2023.10088623(100886)Online publication date: Oct-2023
https://doi.org/10.1016/j.iot.2023.100886

Index Terms

Modular Tangible User Interfaces: Impact of Module Shape and Bonding Strength on Interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models

Recommendations

A specification paradigm for the design and implementation of tangible user interfaces

Tangible interaction shows promise to significantly enhance computer-mediated support for activities such as learning, problem solving, and design. However, tangible user interfaces are currently considered challenging to design and build. Designers and ...
The Future of Tangible User Interfaces
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Tangible user interfaces have a rich history in HCI research ever since their introduction two decades ago. But what are the practical implications, the commercial potential, and the future of this influential paradigm? This panel starts by looking into ...
Tangible User Interfaces Compensate for Low Spatial Cognition
3DUI '08: Proceedings of the 2008 IEEE Symposium on 3D User Interfaces

This research investigates how interacting with tangible user interfaces (TUIs) affects spatial cognition. To study the impact of TUIs, a between subjects study was conducted (n=60) in which students learned about the operation of an anesthesia machine. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '23: Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2023

709 pages

ISBN:9781450399777

DOI:10.1145/3569009

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 February 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Labex Persyval-Lab
French National Research Agency

Conference

TEI '23

Sponsor:

SIGCHI

TEI '23: Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

February 26 - March 1, 2023

Warsaw, Poland

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
529
Total Downloads

Downloads (Last 12 months)210
Downloads (Last 6 weeks)20

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Dominiak JWalczak AStefanidi EAdamkiewicz KGrudzień KNiess JWoźniak P(2024)ProtoBricks: A Research Toolkit for Tangible Prototyping & Data PhysicalizationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661573(476-495)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661573
Yaacoub JNoura HPiranda B(2023)The internet of modular robotic things: Issues, limitations, challenges, & solutionsInternet of Things10.1016/j.iot.2023.10088623(100886)Online publication date: Oct-2023
https://doi.org/10.1016/j.iot.2023.100886

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents