Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3267305.3274113acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

My Watch Says I'm Busy: Inferring Cognitive Load with Low-Cost Wearables

Published: 08 October 2018 Publication History

Abstract

To prevent undesirable effects of attention grabbing at times when a user is occupied with a difficult task, ubiquitous computing devices should be aware of the user's cognitive load. However, inferring cognitive load is extremely challenging, especially when performed without obtrusive, expensive, and purpose-built equipment. In this study we examine the potential for inferring one's cognitive load using merely cheap wearable sensing devices. We subject 25 volunteers to varying cognitive load using six different Primary tasks. In parallel, we collect physiological data with a cheap device, extract features, and then construct machine learning models for cognitive load prediction. As metrics for the load we use one subjective measure, the NASA Task Load Index (NASA-TLX), and two objective measures: task difficulty and reaction time. The leave-one-subject-out evaluation shows a significant influence of the task type and the chosen cognitive load metric on the prediction accuracy.

References

[1]
M.C. Ashton, K. Lee, M Perugini, P Szarota, R.E. de Vries, L Di Blas, K Boies, and B. De Raad. 2004. A six-factor structure of personality-descriptive adjectives: Solutions from psycholexical studies in seven languages: Solutions from psycholexical studies in seven languages. Journal of Personality and Social Psychology 86, 2 (2004), 356--366. Article
[2]
Jelmer P. Borst, Niels A. Taatgen, and Hedderik van Rijn. 2010. The Problem State: A Cognitive Bottleneck in Multitasking. Journal of Experimental Psychology: Learning, Memory, and Cognition 36, 2 (2010), 363--382.
[3]
Jelmer P. Borst, Niels A. Taatgen, and Hedderik van Rijn. 2015. What Makes Interruptions Disruptive?: A Process-Model Account of the Effects of the Problem State Bottleneck on Task Interruption and Resumption. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2971--2980.
[4]
Krista E DeLeeuw and Richard E Mayer. 2008. A Comparison of Three Measures of Cognitive Load: Evidence for Separable Measures of Intrinsic, Extraneous, and Germane load. Journal of Educational Psychology 100, 1 (2008), 223--234.
[5]
Eija Haapalainen, SeungJun Kim, Jodi F. Forlizzi, and Anind K. Dey. 2010. Psycho-physiological Measures for Assessing Cognitive Load. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing (UbiComp '10). ACM, New York, NY, USA, 301--310.
[6]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Advances in Psychology 52 (1988), 139--183.
[7]
G. Jakus K. Novak, K. Stojmenova and J. Sodnik. 2017. Assessment of cognitive load through biometric monitoring. Society for Information Systems and Computer Networks, Ljubljana, Slovenia.
[8]
Fred Paas, Juhani E Tuovinen, Huib Tabbers, and Pascal WM Van Gerven. 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational psychologist 38, 1 (February 2003), 63--71.
[9]
Rahul Rajan, Ted Selker, and Ian Lane. 2016. Task Load Estimation and Mediation Using Psycho-physiological Measures. In Proceedings of the 21st International Conference on Intelligent User Interfaces (IUI '16). ACM, New York, NY, USA, 48--59.
[10]
Dario D. Salvucci and Niels A. Taatgen. 2008. Threaded cognition: An integrated theory of concurrent multitasking. Psychological Review 115, 1 (January 2008), 101--130.
[11]
Florian Schaule, Jan Ole Johanssen, Bernd Bruegge, and Vivian Loftness. 2018. Employing Consumer Wearables to Detect Office Workers' Cognitive Load for Interruption Management. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 32 (March 2018), 20 pages.
[12]
Florian Schmiedek, Martin Lövdén, and Ulman Lindenberger. 2014. A task is a task is a task: putting complex span, n-back, and other working memory indicators in psychometric context. Frontiers in psychology 5 (2014).
[13]
Gašper Urh and Veljko Pejovic. 2016. TaskyApp: Inferring Task Engagement via Smartphone Sensing. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM, New York, NY, USA, 1548--1553.
[14]
Manuela Züger and Thomas Fritz. 2015. Interruptibility of Software Developers and Its Prediction Using Psycho-Physiological Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2981--2990.

Cited By

View all
  • (2024)Investigating Perspectives of and Experiences with Low Cost Commercial Fitness WearablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997408:4(1-22)Online publication date: 21-Nov-2024
  • (2024)Carry-forward effect: providing proactive scaffolding to learning processesBehaviour & Information Technology10.1080/0144929X.2024.2411592(1-40)Online publication date: 16-Oct-2024
  • (2023)Examining Participant Adherence with Wearables in an In-the-Wild SettingSensors10.3390/s2314647923:14(6479)Online publication date: 18-Jul-2023
  • Show More Cited By

Index Terms

  1. My Watch Says I'm Busy: Inferring Cognitive Load with Low-Cost Wearables

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers
    October 2018
    1881 pages
    ISBN:9781450359665
    DOI:10.1145/3267305
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 October 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Cognitive load inference
    2. Mobile sensing
    3. Wearable sensing

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    UbiComp '18
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 764 of 2,912 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)58
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 25 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Investigating Perspectives of and Experiences with Low Cost Commercial Fitness WearablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997408:4(1-22)Online publication date: 21-Nov-2024
    • (2024)Carry-forward effect: providing proactive scaffolding to learning processesBehaviour & Information Technology10.1080/0144929X.2024.2411592(1-40)Online publication date: 16-Oct-2024
    • (2023)Examining Participant Adherence with Wearables in an In-the-Wild SettingSensors10.3390/s2314647923:14(6479)Online publication date: 18-Jul-2023
    • (2023)LAUREATEProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108927:3(1-41)Online publication date: 27-Sep-2023
    • (2023)Carry-Forward Effect: Early scaffolding learning processesProceedings of the 2023 Symposium on Learning, Design and Technology10.1145/3594781.3594786(43-52)Online publication date: 23-Jun-2023
    • (2023)Towards Detecting Tonic Information Processing Activities with Physiological DataAdjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3610679(1-5)Online publication date: 8-Oct-2023
    • (2022)Keep Calm and Do Not Carry-Forward: Toward Sensor-Data Driven AI Agent to Enhance Human LearningFrontiers in Artificial Intelligence10.3389/frai.2021.7131764Online publication date: 12-Jan-2022
    • (2022)Developmental psychologists should adopt citizen science to improve generalization and reproducibilityInfant and Child Development10.1002/icd.234833:1Online publication date: 2-Aug-2022
    • (2021)Cognitive Load Monitoring With Wearables–Lessons Learned From a Machine Learning ChallengeIEEE Access10.1109/ACCESS.2021.30932169(103325-103336)Online publication date: 2021
    • (2021)Wireless Ranging for Contactless Cognitive Load Inference in Ubiquitous ComputingInternational Journal of Human–Computer Interaction10.1080/10447318.2021.191386037:19(1849-1873)Online publication date: 5-May-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media