Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2677199.2680546acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article

The ATB Framework: Quantifying and Classifying Epistemic Strategies in Tangible Problem-Solving Tasks

Published: 15 January 2015 Publication History

Abstract

In task performance, pragmatic actions refer to behaviors that make direct progress, while epistemic actions involve altering the world so that cognitive processes are faster, more reliable or less taxing. Epistemic actions are frequently presented as a beneficial consequence of interacting with tangible systems. However, we currently lack tools to measure epistemic behaviors, making substantiating such claims highly challenging. This paper addresses this problem by presenting ATB, a video-coding framework that enables the identification and measurement of different epistemic actions during problem-solving tasks. The framework was developed through a systematic literature review of 78 papers, and analyzed through a study involving a jigsaw puzzle -- a classical spatial problem -- involving 60 participants. In order to assess the framework's value as a metric, we analyze the study with respect to its reliability, validity and predictive power. The broadly supportive results lead us to conclude that the ATB framework enables the use of observed epistemic behaviors as a performance metric for tangible systems. We believe that the development of metrics focused explicitly on the properties of tangible interaction are currently required to gain insight into the genuine and unique benefits of tangible interaction. The ATB framework is a step towards this goal.

Supplementary Material

MP4 File (p13.mp4)

References

[1]
Antle, A. N. Exploring how children use their hands to think: an embodied interactional analysis. Behaviour & Information Technology (2012).
[2]
Antle, A. N. and Wang, S. Comparing motor-cognitive strategies for spatial problem solving with tangible and multi-touch interfaces. In Procs of TEI'13, ACM, 65--72.
[3]
Clark, A. Being There: Putting Brain, Body, and World Together Again. MIT Press, 1998.
[4]
Ekstrom, R. B., French, J. W., Harman, H. H. and Dermen, D. Manual for Kit of Factor-Referenced Cognitive Tests. Educational Testing Service, 1976.
[5]
Esteves, A., Bakker, S., Antle, A. N., May, A., Warren, J. and Oakley, I. Classifying physical strategies in tangible tasks: a video-coding framework for epistemic actions. In Extended Abs. of CHI'14, ACM, 1843--1848.
[6]
Esteves, A., Hoven, E. v. d. and Oakley, I. Physical games or digital games?: comparing support for mental projection in tangible and virtual representations of a problem-solving task. In Procs of TEI'13, ACM (2013).
[7]
Hart, S. G. and Staveland, L. E. Development of NASATLX (Task Load Index): Results of Empirical and Theoretical Research. In A. H. Peter and M. Najmedin (eds.) Advances in Psychology, 52, (1988), 139--183.
[8]
Horn, M. S. and Jacob, R. J. K. Tangible programming in the classroom with tern. In Extended Abs. of CHI'07, ACM (2007), 1965--1970.
[9]
Hornbæk, K. and Law, E. L.-C. Meta-analysis of correlations among usability measures. In Procs of CHI'07, ACM (2007), 617--626.
[10]
Hornecker, E. and Buur, J. Getting a grip on tangible interaction: a framework on physical space and social interaction. In Procs of CHI'06, ACM (2006), 437--446.
[11]
Hyde, J. S. How large are cognitive gender differences? A meta-analysis using !w² and d. American Psychologist, 36, 8 (1981), 892--901.
[12]
Jacob, R. J. K., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T. and Zigelbaum, J. Reality-based interaction: a framework for post-WIMP interfaces. In Procs of CHI'08, ACM (2008), 201--210.
[13]
Jacob, R. J. K., Ishii, H., Pangaro, G. and Patten, J. A tangible interface for organizing information using a grid. In Procs of CHI'02, ACM (2002), 339--346.
[14]
Jordà, S., Geiger, G., Alonso, M. and Kaltenbrunner, M. The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In Procs of TEI'07, ACM (2007), 139--146.
[15]
Kirsh, D. Adapting the Environment Instead of Oneself. Adaptive Behavior, 4, 3/4 (1996), 415--452.
[16]
Kirsh, D. Complementary strategies: Why we use our hands when we think. In Procs of CogSci'85, 212--217.
[17]
Kirsh, D. Distributed Cognition, Coordination and Environment Design. In Procs of EuroCog'99, 1--11.
[18]
Kirsh, D. The intelligent use of space. Artificial Intelligence, 73, 1--2 (1995), 31--68.
[19]
Kirsh, D. Interactivity and multimedia interfaces. Instructional Science, 25, 2 (1997), 79--96.
[20]
Kirsh, D. and Maglio, P. On Distinguishing Epistemic from Pragmatic Actions. Cognitive Science, 18, 4 (1994), 513--549.
[21]
Klemmer, S. R., Hartmann, B. and Takayama, L. How bodies matter: five themes for interaction design. In Procs of DIS'06, ACM (2006), 140--149.
[22]
MacKay, W. E. Is paper safer? The role of paper flight strips in air traffic control. ACM Trans. Comput.-Hum. Interact., 6, 4 (1999), 311--340.
[23]
Merrill, D., Kalanithi, J. and Maes, P. Siftables: towards sensor network user interfaces. In Procs of TEI'07, ACM (2007), 75--78.
[24]
Shaer, O. and Hornecker, E. Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends in Human-Computer Interaction, 3, 1--137.
[25]
Shapiro, L. Embodied Cognition (New Problems of Philosophy). Routledge, 2011.
[26]
Tarjan, R. E. Amortized Computational Complexity. SIAM. J. on Algebraic and Discrete Methods, 6, 2 (1985), 306--318.
[27]
Underkoffler, J. and Ishii, H. Urp: a luminous-tangible workbench for urban planning and design. In Procs of CHI'99, ACM (1999), 386--393.
[28]
Voyer, D., Voyer, S. and Bryden, P. M. Magnitude of sex differences in spatial abilities: A meta-analysis and consideration of critical variables. Psychological Bulletin, 117, 2 (1995), 250--270.
[29]
Wilson, M. Six views of embodied cognition. Psychonomic Bulletin & Review, 9, 4 (2002).
[30]
Zaman, B., Abeele, V. V., Markopoulos, P. and Marshall, P. Editorial: the evolving field of tangible interaction for children: the challenge of empirical validation. Personal Ubi. Comput., 16, 4, 367--378.

Cited By

View all
  • (2022)Tangible Chromatin: Tangible and Multi-surface Interactions for Exploring Datasets from High-Content Microscopy ExperimentsProceedings of the ACM on Human-Computer Interaction10.1145/35677116:ISS(51-72)Online publication date: 14-Nov-2022
  • (2022)Weaving Fire into FormundefinedOnline publication date: 20-Jul-2022
  • (2019)Keep the Ball RollingProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322280(215-226)Online publication date: 18-Jun-2019
  • Show More Cited By

Index Terms

  1. The ATB Framework: Quantifying and Classifying Epistemic Strategies in Tangible Problem-Solving Tasks

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction
    January 2015
    766 pages
    ISBN:9781450333054
    DOI:10.1145/2677199
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 January 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. epistemic actions
    2. tangible interaction
    3. video-coding

    Qualifiers

    • Research-article

    Funding Sources

    • Portuguese Foundation of Science and Technology (FCT)
    • SSHRC and GRAND NCE (Canada)
    • National Research Foundation of Korea (NRF)

    Conference

    TEI '15
    Sponsor:

    Acceptance Rates

    TEI '15 Paper Acceptance Rate 63 of 222 submissions, 28%;
    Overall Acceptance Rate 393 of 1,367 submissions, 29%

    Upcoming Conference

    TEI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)9
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 08 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Tangible Chromatin: Tangible and Multi-surface Interactions for Exploring Datasets from High-Content Microscopy ExperimentsProceedings of the ACM on Human-Computer Interaction10.1145/35677116:ISS(51-72)Online publication date: 14-Nov-2022
    • (2022)Weaving Fire into FormundefinedOnline publication date: 20-Jul-2022
    • (2019)Keep the Ball RollingProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322280(215-226)Online publication date: 18-Jun-2019
    • (2018)The Effect of Augmented and Virtual Reality Interfaces in the Creative Design ProcessInternational Journal of Virtual and Augmented Reality10.4018/IJVAR.20180101012:1(1-13)Online publication date: 1-Jan-2018
    • (2018)A Look at the Effects of Handheld and Projected Augmented-reality on a Collaborative TaskProceedings of the 2018 ACM Symposium on Spatial User Interaction10.1145/3267782.3267793(74-78)Online publication date: 13-Oct-2018
    • (2017)Evaluating the effect of tangible virtual reality on spatial perspective taking abilityProceedings of the 5th Symposium on Spatial User Interaction10.1145/3131277.3132171(68-77)Online publication date: 16-Oct-2017
    • (2016)Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization TasksProceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/2839462.2839464(279-286)Online publication date: 14-Feb-2016
    • (2015)DisplayPointersProceedings of the 12th International Conference on Advances in Computer Entertainment Technology10.1145/2832932.2832958(1-8)Online publication date: 16-Nov-2015

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media