research-article

If Your Mind Can Grasp It, Your Hands Will Help

Authors:

Andreas ButzAuthors Info & Claims

TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 92 - 99

https://doi.org/10.1145/2839462.2839476

Published: 14 February 2016 Publication History

Abstract

This paper describes a study comparing the information recall of participants using 2D and 3D physical visualizations. Specifically, it focuses on physical bar charts and evaluates the difference between a paper-based visualization and a version built with wooden blocks. We conducted a repeated measures study involving 16 participants in which we measured the recall of information immediately after the exploration and with a delay of one week. We used questionnaires and semi-structured interviews to obtain more information about the process of recall and participants' opinions whether and how the visualizations differ in their potential for memorizing information. The results point out that participants believe to remember the 3D visualizations better, but besides the recall of extreme values the quantitative data cannot completely verify this appreciation. Furthermore the results highlight that the in the study used physical interaction techniques are not able to compensate lacking visual differentiation. One surprising finding was the strong dependency of the different data sets on the recall performance.

References

[1]

Scott Bateman, Regan L. Mandryk, Carl Gutwin, Aaron Genest, David McDine, and Christopher Brooks. 2010. Useful Junk?: The Effects of Visual Embellishment on Comprehension and Memorability of Charts. In CHI '10. ACM, New York, NY, USA, 2573--2582.

Digital Library

[2]

William Bevan and Joseph A Steger. 1971. Free recall and abstractness of stimuli. Science 172, 3983 (1971), 597--599.

[3]

Michelle Borkin, Azalea Vo, Zoya Bylinskii, Phillip Isola, Shashank Sunkavalli, Alfonso Oliva, Hanspeter Pfister, and others. 2013. What makes a visualization memorable? Visualization and Computer Graphics, IEEE Transactions on 19, 12 (2013), 2306--2315.

Digital Library

[4]

Stuart K Card, Jock D Mackinlay, and Ben Shneiderman. 1999. Readings in information visualization: using vision to think. Morgan Kaufmann.

Digital Library

[5]

Fanny Chevalier, Pierre Dragicevic, and Steven Franconeri. 2014. The not-so-staggering effect of staggered animated transitions on visual tracking. Visualization and Computer Graphics, IEEE Transactions on 20, 12 (2014), 2241--2250.

[6]

Andy Cockburn and Bruce McKenzie. 2002. Evaluating the Effectiveness of Spatial Memory in 2D and 3D Physical and Virtual Environments. In CHI '02. ACM, New York, NY, USA, 203--210.

Digital Library

[7]

Geoff Cumming. 2013. The new statistics why and how. Psychological science (2013), 0956797613504966.

[8]

Pierre Dragicevic. 2015. HCI Statistics without p-values. Research Report RR-8738. Inria. 32 pages. https://hal.inria.fr/hal-01162238

[9]

Randolph D Easton, Anthony J Greene, and Kavitha Srinivas. 1997. Transfer between vision and haptics: Memory for 2-D patterns and 3-D objects. Psychonomic Bulletin & Review 4, 3 (1997), 403--410.

[10]

Mark Hancock, Otmar Hilliges, Christopher Collins, Dominikus Baur, and Sheelagh Carpendale. 2009. Exploring Tangible and Direct Touch Interfaces for Manipulating 2D and 3D Information on a Digital Table. In ITS '09. ACM, New York, NY, USA, 77--84.

Digital Library

[11]

George Hein. 1991. Constructivist learning theory. Institute for Inquiry. (1991). http://www.exploratorium.edu/ifi/resources/constructivistlearning.html

[12]

Samuel Huron, Yvonne Jansen, and Sheelagh Carpendale. 2014. Constructing visual representations: Investigating the use of tangible tokens. Visualization and Computer Graphics, IEEE Transactions on 20, 12 (2014), 2102--2111.

[13]

Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In CHI '97. ACM, New York, NY, USA, 234--241.

Digital Library

[14]

Yvonne Jansen, Pierre Dragicevic, and Jean-Daniel Fekete. 2013. Evaluating the Efficiency of Physical Visualizations. In CHI '13. ACM, New York, NY, USA, 2593--2602.

Digital Library

[15]

Yvonne Jansen, Pierre Dragicevic, Petra Isenberg, Jason Alexander, Abhijit Karnik, Johan Kildal, Sriram Subramanian, and Kasper Hornbæk. 2015. Opportunities and Challenges for Data Physicalization. In CHI '15. ACM, New York, NY, USA, 3227--3236.

Digital Library

[16]

Hans-Christian Jetter, Jens Gerken, Michael Zöllner, Harald Reiterer, and Natasa Milic-Frayling. 2011. Materializing the Query with Facet-streams: A Hybrid Surface for Collaborative Search on Tabletops. In CHI '11. ACM, New York, NY, USA, 3013--3022.

Digital Library

[17]

Jonathan W Kelly, Marios N Avraamides, and Nicholas A Giudice. 2011. Haptic experiences influence visually acquired memories: Reference frames during multimodal spatial learning. Psychonomic bulletin & review 18, 6 (2011), 1119--1125.

[18]

Dirk Kerzel. 2001. Visual short-term memory is influenced by haptic perception. Journal of Experimental Psychology: Learning, Memory, and Cognition 27, 4 (2001), 1101--1109.

[19]

Rohit Ashok Khot, Larissa Hjorth, and Florian 'Floyd' Mueller. 2014. Understanding Physical Activity Through 3D Printed Material Artifacts. In CHI '14. ACM, New York, NY, USA, 3835--3844.

Digital Library

[20]

Claire Knight. 1998. Visualisation for program comprehension: information and issues. Citeseer.

[21]

Susan J Lederman and Roberta L Klatzky. 2009. Haptic perception: A tutorial. Attention, Perception, & Psychophysics 71, 7 (2009), 1439--1459.

[22]

Paul Marshall, Peter C.-H. Cheng, and Rosemary Luckin. 2010. Tangibles in the Balance: A Discovery Learning Task with Physical or Graphical Materials. In TEI '10. ACM, New York, NY, USA, 153--160.

Digital Library

[23]

Claire O'Malley and Danae Stanton Fraser. 2004. Literature Review in Learning with Tangible Technologies. Research report. (2004). https://telearn.archives-ouvertes.fr/hal-00190328

[24]

Keith G Scott. 1967. Clustering with perceptual and symbolic stimuli in free recall. Journal of Verbal Learning and Verbal Behavior 6, 6 (1967), 864--866.

[25]

Simon Stusak, Jeannette Schwarz, and Andreas Butz. 2015. Evaluating the Memorability of Physical Visualizations. In CHI '15. ACM, New York, NY, USA, 3247--3250.

Digital Library

[26]

Simon Stusak, Aurélien Tabard, Franziska Sauka, Rohit Ashok Khot, and Andreas Butz. 2014. Activity sculptures: Exploring the impact of physical visualizations on running activity. Visualization and Computer Graphics, IEEE Transactions on 20, 12 (2014), 2201--2210.

[27]

Saiganesh Swaminathan, Conglei Shi, Yvonne Jansen, Pierre Dragicevic, Lora A. Oehlberg, and Jean-Daniel Fekete. 2014. Supporting the Design and Fabrication of Physical Visualizations. In CHI '14. ACM, New York, NY, USA, 3845--3854.

Digital Library

[28]

Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbæk, and Jason Alexander. 2015. Exploring Interactions with Physically Dynamic Bar Charts. In CHI '15. ACM, New York, NY, USA, 3237--3246.

Digital Library

[29]

Melanie Tory, Colin Swindells, and Rebecca Dreezer. 2009. Comparing dot and landscape spatializations for visual memory differences. Visualization and Computer Graphics, IEEE Transactions on 15, 6 (2009), 1033--1040.

Digital Library

[30]

Lara M Triona and David Klahr. 2003. Point and click or grab and heft: Comparing the influence of physical and virtual instructional materials on elementary school students' ability to design experiments. Cognition and Instruction 21, 2 (2003), 149--173.

[31]

Edward R Tufte and PR Graves-Morris. 1983. The visual display of quantitative information. Vol. 2. Graphics press Cheshire, CT.

Digital Library

[32]

Benton J Underwood. 1957. Interference and forgetting. Psychological review 64, 1 (1957), 49.

[33]

Colin Ware. 2012. Information visualization: perception for design. Elsevier.

Digital Library

[34]

Erica L Wohldmann, Alice F Healy, and Lyle E Bourne Jr. 2008. A mental practice superiority effect: less retroactive interference and more transfer than physical practice. Journal of Experimental Psychology: Learning, Memory, and Cognition 34, 4 (2008), 823.

[35]

Zacharias C Zacharia and Georgios Olympiou. 2011. Physical versus virtual manipulative experimentation in physics learning. Learning and Instruction 21, 3 (2011), 317--331.

[36]

Oren Zuckerman, Saeed Arida, and Mitchel Resnick. 2005. Extending Tangible Interfaces for Education: Digital Montessori-inspired Manipulatives. In CHI '05. ACM, New York, NY, USA, 859--868.

Digital Library

Cited By

Hayes SLindrup MNoonan RZimmerman LHeffernan DSauvé KBressa NHuron SHogan TCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Are Conferences Sus?: Fostering Conversations on the Sustainability of HCI Conferences Through Data PhysicalizationProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3634742(1-5)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3634742
Han KTang KWang MCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Tangible Diffusion: Exploring Artwork Generation via Tangible Elements and AI Generative Models in Arts and Design EducationProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633394(1-13)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633394
Perovich LZizzi NCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Feeling Data through Movement: Designing Somatic Data Experiences with DancersProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633371(1-11)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633371
Show More Cited By

Index Terms

If Your Mind Can Grasp It, Your Hands Will Help
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Evaluating the Memorability of Physical Visualizations
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Physical Visualizations are currently mostly used in casual contexts, e.g., as artistic data sculptures. However, their measurable benefits for traditional information visualization are largely unexplored. As a step in this direction, we compared the ...
Evaluating the efficiency of physical visualizations
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Data sculptures are an increasingly popular form of physical visualization whose purposes are essentially artistic, communicative or educational. But can physical visualizations help carry out actual information visualization tasks? We present the first ...
Can background baroque music help to improve the memorability of graphical passwords?
ICIAR'10: Proceedings of the 7th international conference on Image Analysis and Recognition - Volume Part II

Graphical passwords have been proposed as an alternative to alphanumeric passwords with their advantages in usability and security. However, they still tend to follow predictable patterns that are easier for attackers to exploit, probably due to users' ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2016

820 pages

ISBN:9781450335829

DOI:10.1145/2839462

Conference Chairs:
Saskia Bakker,
Caroline Hummels,
Brygg Ullmer,
Program Chairs:
Luc Geurts,
Bart Hengeveld,
Daniel Saakes,
Publications Chair:
Mendel Broekhuijsen

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 February 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Paper

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

TEI '16

TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

February 14 - 17, 2016

Eindhoven, Netherlands

Acceptance Rates

TEI '16 Paper Acceptance Rate 45 of 178 submissions, 25%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
642
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hayes SLindrup MNoonan RZimmerman LHeffernan DSauvé KBressa NHuron SHogan TCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Are Conferences Sus?: Fostering Conversations on the Sustainability of HCI Conferences Through Data PhysicalizationProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3634742(1-5)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3634742
Han KTang KWang MCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Tangible Diffusion: Exploring Artwork Generation via Tangible Elements and AI Generative Models in Arts and Design EducationProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633394(1-13)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633394
Perovich LZizzi NCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Feeling Data through Movement: Designing Somatic Data Experiences with DancersProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633371(1-11)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633371
Bae SFujiwara TYnnerman ADo ERivera MSzafir D(2024)A Computational Design Pipeline to Fabricate Sensing Network PhysicalizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332719830:1(913-923)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3327198
Barbosa CSousa TMonteiro WAraújo TMeiguins B(2023)Enhancing Color Scales for Active Data PhysicalizationsApplied Sciences10.3390/app1401016614:1(166)Online publication date: 24-Dec-2023
https://doi.org/10.3390/app14010166
Bouzekri ERivière G(2023)Validating Design Choices of a Bio-Inspired Histogram to Support a Shared Practice of Clean Energy at the WorkplaceProceedings of the 34th Conference on l'Interaction Humain-Machine10.1145/3583961.3583965(1-20)Online publication date: 3-Apr-2023
https://dl.acm.org/doi/10.1145/3583961.3583965
Eslambolchilar PStawarz KVerdezoto Dias NMcNarry MCrossley SKnowles ZMackintosh K(2023)Tangible data visualization of physical activity for children and adolescentsInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10056535:COnline publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100565
Dodani AVan Koningsbruggen RHornecker E(2022)Birdbox: Exploring the User Experience of Crossmodal, Multisensory Data RepresentationsProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568455(12-21)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568455
Bae SZheng CWest MDo EHuron SSzafir D(2022)Making Data Tangible: A Cross-disciplinary Design Space for Data PhysicalizationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501939(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501939
van Loenhout RRanasinghe CDegbelo ABouali N(2022)Physicalizing Sustainable Development Goals Data: An Example with SDG 7 (Affordable and Clean Energy)Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519638(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519638
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten