research-article

Reconfiguration Strategies with Composite Data Physicalizations

Authors:

Jason Alexander,

Steven HoubenAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 471, Pages 1 - 18

https://doi.org/10.1145/3411764.3445746

Published: 07 May 2021 Publication History

Abstract

Composite data physicalizations allow for the physical reconfiguration of data points, creating new opportunities for interaction and engagement. However, there is a lack of understanding of people’s strategies and behaviors when directly manipulating physical data objects. In this paper, we systematically characterize different reconfiguration strategies using six exemplar physicalizations. We asked 20 participants to reorganize these exemplars with two levels of restriction: changing a single data object versus changing multiple data objects. Our findings show that there were two main reconfiguration strategies used: changes in proximity and changes in atomic orientation. We further characterize these using concrete examples of participant actions in relation to the structure of the physicalizations. We contribute an overview of reconfiguration strategies, which informs the design of future manually reconfigurable and dynamic composite physicalizations.

Supplementary Material

VTT File (3411764.3445746_videopreviewcaptions.vtt)

Download
.76 KB

MP4 File (3411764.3445746_videopreview.mp4)

Preview video

Download
5.89 MB

References

[1]

Jason Alexander, Anne Roudaut, Jürgen Steimle, Kasper Hornbæk, Miguel Bruns Alonso, Sean Follmer, and Timothy Merritt. 2018. Grand Challenges in Shape-Changing Interface Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173873

Digital Library

[2]

Laura Armstrong and Lawrence E. Marks. 1999. Haptic perception of linear extent. Perception & Psychophysics 61, 6 (1999), 1211–1226.

[3]

Fred Attneave and Malcolm D. Arnoult. 1956. The quantitative study of shape and pattern perception.Psychological bulletin 53, 6 (1956), 452.

[4]

David L. Davies and Donald W. Bouldin. 1979. A Cluster Separation Measure. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-1, 2(1979), 224–227. https://doi.org/10.1109/TPAMI.1979.4766909

Digital Library

[5]

Pierre Dragicevic and Yvonne Jansen. 2012. List of Physical Visualizations. www.dataphys.org/list. Last accessed Nov 2020.

[6]

Madison A. Elliott, Christine Nothelfer, Cindy Xiong, and Danielle Albers Szafir. 2020. A Design Space of Vision Science Methods for Visualization Research. IEEE Transactions on Visualization and Computer Graphics (2020). https://doi.org/10.1109/TVCG.2020.3029413

[7]

Aluna Everitt, Faisal Taher, and Jason Alexander. 2016. ShapeCanvas: An Exploration of Shape-Changing Content Generation by Members of the Public. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). ACM, New York, NY, USA, 2778–2782. https://doi.org/10.1145/2858036.2858316

Digital Library

[8]

Danyang Fan, Alexa Fay Siu, Sile O’Modhrain, and Sean Follmer. 2020. Constructive Visualization to Inform the Design and Exploration of Tactile Data Representations. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event, Greece) (ASSETS ’20). ACM, New York, NY, USA, Article 60, 4 pages. https://doi.org/10.1145/3373625.3418027

Digital Library

[9]

Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. InFORM: Dynamic Physical Affordances and Constraints through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). ACM, New York, NY, USA, 417–426. https://doi.org/10.1145/2501988.2502032

Digital Library

[10]

Pauline Gourlet and Thierry Dassé. 2017. Cairn: A Tangible Apparatus for Situated Data Collection, Visualization and Analysis. In Proceedings of the 2017 Conference on Designing Interactive Systems (Edinburgh, United Kingdom) (DIS ’17). ACM, New York, NY, USA, 247–258. https://doi.org/10.1145/3064663.3064794

Digital Library

[11]

Jeffrey Heer and Michael Bostock. 2010. Crowdsourcing Graphical Perception: Using Mechanical Turk to Assess Visualization Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). ACM, New York, NY, USA, 203–212. https://doi.org/10.1145/1753326.1753357

Digital Library

[12]

Eva Hornecker and Jacob Buur. 2006. Getting a Grip on Tangible Interaction: A Framework on Physical Space and Social Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada) (CHI ’06). ACM, New York, NY, USA, 437–446. https://doi.org/10.1145/1124772.1124838

Digital Library

[13]

Samuel Huron, Sheelagh Carpendale, Alice Thudt, Anthony Tang, and Michael Mauerer. 2014. Constructive Visualization. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS ’14). ACM, New York, NY, USA, 433–442. https://doi.org/10.1145/2598510.2598566

Digital Library

[14]

Samuel Huron, Yvonne Jansen, and Sheelagh Carpendale. 2014. Constructing Visual Representations: Investigating the Use of Tangible Tokens. IEEE Transactions on Visualization and Computer Graphics 20, 12(2014), 2102–2111. https://doi.org/10.1109/TVCG.2014.2346292

[15]

Yvonne Jansen and Pierre Dragicevic. 2013. An Interaction Model for Visualizations Beyond The Desktop. IEEE Transactions on Visualization and Computer Graphics 19, 12(2013), 2396–2405. https://doi.org/10.1109/TVCG.2013.134

Digital Library

[16]

Yvonne Jansen, Pierre Dragicevic, and Jean-Daniel Fekete. 2013. Evaluating the Efficiency of Physical Visualizations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). ACM, New York, NY, USA, 2593–2602. https://doi.org/10.1145/2470654.2481359

Digital Library

[17]

Yvonne Jansen, Pierre Dragicevic, Petra Isenberg, Jason Alexander, Abhijit Karnik, Johan Kildal, Sriram Subramanian, and Kasper Hornbæk. 2015. Opportunities and Challenges for Data Physicalization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). ACM, New York, NY, USA, 3227–3236. https://doi.org/10.1145/2702123.2702180

Digital Library

[18]

Yvonne Jansen and Kasper Hornbæk. 2016. A Psychophysical Investigation of Size as a Physical Variable. IEEE Transactions on Visualization and Computer Graphics 22, 1(2016), 479–488. https://doi.org/10.1109/TVCG.2015.2467951

Digital Library

[19]

Rohit Ashok Khot, Jeewon Lee, Larissa Hjorth, and Florian ’Floyd’ Mueller. 2014. SweatAtoms: Understanding Physical Activity through Material Artifacts. In CHI ’14 Extended Abstracts on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI EA ’14). ACM, New York, NY, USA, 173–174. https://doi.org/10.1145/2559206.2579479

Digital Library

[20]

David Kirsh. 1995. The Intelligent Use of Space. Artificial Intelligence 73, 1–2 (1995), 31–68. https://doi.org/10.1016/0004-3702(94)00017-U

Digital Library

[21]

Kurt Koffka. 2013. Principles of Gestalt Psychology. The International Library of Psychology, Vol. 44. Routledge.

[22]

Mathieu Le Goc, Lawrence H. Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building Blocks for Swarm User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). ACM, New York, NY, USA, 97–109. https://doi.org/10.1145/2984511.2984547

Digital Library

[23]

Mathieu Le Goc, Charles Perin, Sean Follmer, Jean-Daniel Fekete, and Pierre Dragicevic. 2018. Dynamic Composite Data Physicalization Using Wheeled Micro-Robots. IEEE Transactions on Visualization and Computer Graphics 25, 1(2018), 737–747. https://doi.org/10.1109/TVCG.2018.2865159

Digital Library

[24]

Daniel Leithinger and Hiroshi Ishii. 2010. Relief: A Scalable Actuated Shape Display. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (Cambridge, Massachusetts, USA) (TEI ’10). ACM, New York, NY, USA, 221–222. https://doi.org/10.1145/1709886.1709928

Digital Library

[25]

Zhicheng Liu and John Stasko. 2010. Mental Models, Visual Reasoning and Interaction in Information Visualization: A Top-down Perspective. IEEE Transactions on Visualization and Computer Graphics 16, 6(2010), 999–1008. https://doi.org/10.1109/TVCG.2010.177

Digital Library

[26]

Deborah Lupton. 2017. Feeling your data: Touch and making sense of personal digital data. New Media & Society 19, 10 (2017), 1599–1614.

[27]

Tamara Munzner. 2014. Visualization Analysis and Design. CRC Press, Boca Raton FL, United States.

[28]

Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk. 2012. Shape-Changing Interfaces: A Review of the Design Space and Open Research Questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). ACM, New York, NY, USA, 735–744. https://doi.org/10.1145/2207676.2207781

Digital Library

[29]

Kim Sauvé, Dominic Potts, Jason Alexander, and Steven Houben. 2020. A Change of Perspective: How User Orientation Influences the Perception of Physicalizations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376312

Digital Library

[30]

Stephen Smart and Danielle Albers Szafir. 2019. Measuring the Separability of Shape, Size, and Color in Scatterplots. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300899

Digital Library

[31]

Miriam Sturdee, John Hardy, Nick Dunn, and Jason Alexander. 2015. A Public Ideation of Shape-Changing Applications. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (Madeira, Portugal) (ITS ’15). ACM, New York, NY, USA, 219–228. https://doi.org/10.1145/2817721.2817734

Digital Library

[32]

Simon Stusak, Aurélien Tabard, Franziska Sauka, Rohit Ashok Khot, and Andreas Butz. 2014. Activity Sculptures: Exploring the Impact of Physical Visualizations on Running Activity. IEEE Transactions on Visualization and Computer Graphics 20, 12(2014), 2201–2210. https://doi.org/10.1109/TVCG.2014.2352953

[33]

Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbæk, and Jason Alexander. 2015. Exploring Interactions with Physically Dynamic Bar Charts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). ACM, New York, NY, USA, 3237–3246. https://doi.org/10.1145/2702123.2702604

Digital Library

[34]

Faisal Taher, Yvonne Jansen, Jonathan Woodruff, John Hardy, Kasper Hornbæk, and Jason Alexander. 2017. Investigating the Use of a Dynamic Physical Bar Chart for Data Exploration and Presentation. IEEE Transactions on Visualization and Computer Graphics 23, 1(2017), 451–460. https://doi.org/10.1109/TVCG.2016.2598498

Digital Library

[35]

Alice Thudt, Uta Hinrichs, Samuel Huron, and Sheelagh Carpendale. 2018. Self-Reflection and Personal Physicalization Construction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173728

Digital Library

[36]

Colin Ware. 2019. Information Visualization: Perception for Design. Morgan Kaufmann, Cambridge MA, United States.

[37]

Tiffany Wun, Jennifer Payne, Samuel Huron, and Sheelagh Carpendale. 2016. Comparing Bar Chart Authoring with Microsoft Excel and Tangible Tiles. Computer Graphics Forum 35, 3 (2016), 111–120. https://doi.org/10.1111/cgf.12887

Cited By

Biørn-Hansen ALindrup MEriksson EPargman DLaaksolahti J(2024)Dealing with carbon: physicalisation of academic flying to support collective meaning-making for a low-carbon academiaBehaviour & Information Technology10.1080/0144929X.2024.240836643:14(3371-3388)Online publication date: 30-Sep-2024
https://doi.org/10.1080/0144929X.2024.2408366
Cooper CBuur J(2024)Exploring bike-commuter habits through data physicalisation engagementBehaviour & Information Technology10.1080/0144929X.2024.239643343:14(3340-3355)Online publication date: 3-Oct-2024
https://doi.org/10.1080/0144929X.2024.2396433
Barbosa CSousa TMonteiro WAraújo TMeiguins B(2023)Enhancing Color Scales for Active Data PhysicalizationsApplied Sciences10.3390/app1401016614:1(166)Online publication date: 24-Dec-2023
https://doi.org/10.3390/app14010166
Show More Cited By

Index Terms

Reconfiguration Strategies with Composite Data Physicalizations
1. Human-centered computing

Index terms have been assigned to the content through auto-classification.

Recommendations

Physecology: A Conceptual Framework to Describe Data Physicalizations in their Real-World Context
The standard definition for “physicalizations” is “a physical artifact whose geometry or material properties encode data” [47]. While this working definition provides the fundamental groundwork for conceptualizing physicalization, in practice many ...
Opportunities and Challenges for Data Physicalization
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Physical representations of data have existed for thousands of years. Yet it is now that advances in digital fabrication, actuated tangible interfaces, and shape-changing displays are spurring an emerging area of research that we call Data ...
Put a Label On It! Approaches for Constructing and Contextualizing Bar Chart Physicalizations
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Physicalizations represent data through their tangible and material properties. In contrast to screen-based visualizations, there is currently very limited understanding of how to label or annotate physicalizations to support people in interpreting the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
431
Total Downloads

Downloads (Last 12 months)83
Downloads (Last 6 weeks)8

Reflects downloads up to 01 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Biørn-Hansen ALindrup MEriksson EPargman DLaaksolahti J(2024)Dealing with carbon: physicalisation of academic flying to support collective meaning-making for a low-carbon academiaBehaviour & Information Technology10.1080/0144929X.2024.240836643:14(3371-3388)Online publication date: 30-Sep-2024
https://doi.org/10.1080/0144929X.2024.2408366
Cooper CBuur J(2024)Exploring bike-commuter habits through data physicalisation engagementBehaviour & Information Technology10.1080/0144929X.2024.239643343:14(3340-3355)Online publication date: 3-Oct-2024
https://doi.org/10.1080/0144929X.2024.2396433
Barbosa CSousa TMonteiro WAraújo TMeiguins B(2023)Enhancing Color Scales for Active Data PhysicalizationsApplied Sciences10.3390/app1401016614:1(166)Online publication date: 24-Dec-2023
https://doi.org/10.3390/app14010166
Hornecker EHogan THinrichs UVan Koningsbruggen R(2023)A Design Vocabulary for Data PhysicalizationACM Transactions on Computer-Human Interaction10.1145/361736631:1(1-62)Online publication date: 29-Nov-2023
https://dl.acm.org/doi/10.1145/3617366
Sauvé KBrombacher HVan Koningsbruggen RVeldhuis AHouben SAlexander J(2023)Physicalization from Theory to Practice: Exploring Physicalization Design across DomainsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3573824(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3573824
Zhang XHan DDong YRen X(2023)DataVisage: A Card-Based Design Workshop to Support Design Ideation on Data PhysicalizationEntertainment Computing – ICEC 202310.1007/978-981-99-8248-6_45(471-483)Online publication date: 15-Nov-2023
https://dl.acm.org/doi/10.1007/978-981-99-8248-6_45
Dodani AVan Koningsbruggen RHornecker E(2022)Birdbox: Exploring the User Experience of Crossmodal, Multisensory Data RepresentationsProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568455(12-21)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568455
Sauvé KSturdee MHouben S(2022)Physecology: A Conceptual Framework to Describe Data Physicalizations in their Real-World ContextACM Transactions on Computer-Human Interaction10.1145/350559029:3(1-33)Online publication date: 14-Jan-2022
https://dl.acm.org/doi/10.1145/3505590
Sauvé KRamirez Gomez AHouben S(2022)Put a Label On It! Approaches for Constructing and Contextualizing Bar Chart PhysicalizationsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501952(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501952
Bae SZheng CWest MDo EHuron SSzafir D(2022)Making Data Tangible: A Cross-disciplinary Design Space for Data PhysicalizationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501939(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501939
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten