poster

Classifying physical strategies in tangible tasks: a video-coding framework for epistemic actions

Authors:

Ian OakleyAuthors Info & Claims

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Pages 1843 - 1848

https://doi.org/10.1145/2559206.2581185

Published: 26 April 2014 Publication History

Get Access

Abstract

Tangible interaction is a compelling interface paradigm that elegantly merges the fluency of physical manipulation with the flexibility of digital content. However, it is currently challenging to understand the real benefits and advantages of tangible systems. To address this problem, this paper argues that we need new evaluation techniques capable of meaningfully assessing how users perform with tangible, physical objects. Working towards this aim, it presents a video-coding framework that supports the granular identification of epistemic actions (physical actions that are made to simplify cognitive work) during tangible tasks. The framework includes 20 epistemic actions, identified through a systematic literature review of 77 sources. We argue that data generated by applying this process will help us better understand epistemic behavior and, ultimately, lead to the generation of novel, grounded design insights to support physically-grounded cognitive strategies in tangible tasks.

Supplementary Material

ZIP File (wip0224-file3.zip)

Zip file containing a PDF of the Accompanying Poster

Download
2.04 MB

References

[1]

Antle, A. N. and Wang, S. Comparing motorcognitive strategies for spatial problem solving with tangible and multi-touch interfaces. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction, ACM (2013), 6572.

Digital Library

Google Scholar

[2]

Clark, A. Being There: Putting Brain, Body, and World Together Again. MIT Press, 1998.

Digital Library

Google Scholar

[3]

Esteves, A., Hoven, E. v. d. and Oakley, I. Physical games or digital games : comparing support for mental projection in tangible and virtual representations of a problem-solving task. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction, ACM (2013), 167--174.

Digital Library

Google Scholar

[4]

Hornecker, E. Beyond affordance: tangibles' hybrid nature. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, ACM (2012), 175--182.

Digital Library

Google Scholar

[5]

Hornecker, E. and Buur, J. Getting a grip on tangible interaction: a framework on physical space and social interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2006), 437--446.

Digital Library

Google Scholar

[6]

Jacob, R. J. K., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T. and Zigelbaum, J. Reality-based interaction: a framework for post-WIMP interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2008), 201--210.

Digital Library

Google Scholar

[7]

Kirsh, D. Complementary strategies: Why we use our hands when we think. In Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society (1985), 212--217.

Google Scholar

[8]

Kirsh, D. The intelligent use of space. Artificial Intelligence, 73, 1--2 (1995), 31--68.

Digital Library

Google Scholar

[9]

Kirsh, D. and Maglio, P. On Distinguishing Epistemic from Pragmatic Actions. Cognitive Science, 18, 4 (1994), 513--549.

Crossref

Google Scholar

[10]

Klemmer, S. R., Hartmann, B. and Takayama, L. How bodies matter: five themes for interaction design. In Proceedings of the 6th conference on Designing Interactive systems, ACM (2006), 140--149.

Digital Library

Google Scholar

[11]

Shaer, O. and Hornecker, E. Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends in Human-Computer Interaction, 3 (2010), 1--137.

Digital Library

Google Scholar

[12]

Shapiro, L. Embodied Cognition (New Problems of Philosophy). Routledge, 2011.

Google Scholar

[13]

Tarjan, R. E. Amortized Computational Complexity. SIAM. J. on Algebraic and Discrete Methods, 6, 2 (1985), 306--318.

Google Scholar

[14]

Wilson, M. Six views of embodied cognition. Psychonomic Bulletin & Review, 9, 4 (2002).

Crossref

Google Scholar

Cited By

View all

Chang JDoucette AYeboah GWelsh TNitsche MMazalek AHarrison SBardzell SNeustaedter CTatar D(2019)Keep the Ball RollingProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322280(215-226)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322280
Girouard AShaer OSolovey EPoor GJacob R(2019)The Reality of Reality-Based InteractionACM Transactions on Computer-Human Interaction10.1145/331961726:5(1-35)Online publication date: 12-Sep-2019
https://dl.acm.org/doi/10.1145/3319617
Chang JInakage MIshii HDo ESteimle JShaer OKunze KPeiris R(2017)The Design and Evaluation of Embodied Interfaces for Supporting Spatial AbilityProceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3024969.3025033(681-684)Online publication date: 20-Mar-2017
https://dl.acm.org/doi/10.1145/3024969.3025033
Show More Cited By

Index Terms

Classifying physical strategies in tangible tasks: a video-coding framework for epistemic actions
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

Interactive visualization plays a key role in the analysis of large datasets. It can help users to explore data, investigate hypotheses and find patterns. The easier and more tangible the interaction, the more likely it is to enhance understanding. This ...
Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection
NordiCHI '12: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design

In this paper we present the tangible 3D tabletop and discuss the design potential of this novel interface. The tangible 3D tabletop combines tangible tabletop interaction with 3D projection in such a way that the tangible objects may be augmented with ...
Tangible Meets Gestural: Comparing and Blending Post-WIMP Interaction Paradigms
TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

More and more objects of our everyday environment are becoming smart and connected, offering us new interaction possibilities. Tangible interaction and gestural interaction are promising communication means with these objects in this post-WIMP ...

Comments

Information & Contributors

Information

Published In

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

April 2014

2620 pages

ISBN:9781450324748

DOI:10.1145/2559206

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Check for updates

Author Tags

Qualifiers

Poster

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI EA '14 Paper Acceptance Rate 1,000 of 3,200 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
197
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chang JDoucette AYeboah GWelsh TNitsche MMazalek AHarrison SBardzell SNeustaedter CTatar D(2019)Keep the Ball RollingProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322280(215-226)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322280
Girouard AShaer OSolovey EPoor GJacob R(2019)The Reality of Reality-Based InteractionACM Transactions on Computer-Human Interaction10.1145/331961726:5(1-35)Online publication date: 12-Sep-2019
https://dl.acm.org/doi/10.1145/3319617
Chang JInakage MIshii HDo ESteimle JShaer OKunze KPeiris R(2017)The Design and Evaluation of Embodied Interfaces for Supporting Spatial AbilityProceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3024969.3025033(681-684)Online publication date: 20-Mar-2017
https://dl.acm.org/doi/10.1145/3024969.3025033
Esteves ABakker SAntle AMay AWarren JOakley IVerplank BJu WAntle AMazalek AMueller F(2015)The ATB FrameworkProceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/2677199.2680546(13-20)Online publication date: 15-Jan-2015
https://dl.acm.org/doi/10.1145/2677199.2680546

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks

Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection

Tangible Meets Gestural: Comparing and Blending Post-WIMP Interaction Paradigms