research-article

Non-Invasive Measurement of Cognitive Load and Stress Based on the Reflected Stress-Induced Vascular Response Index

Authors:

Yuanchun ShiAuthors Info & Claims

ACM Transactions on Applied Perception (TAP), Volume 15, Issue 3

Article No.: 17, Pages 1 - 17

https://doi.org/10.1145/3185665

Published: 24 July 2018 Publication History

Abstract

Measuring cognitive load and stress is crucial for ubiquitous human--computer interaction applications to dynamically understand and respond to the mental status of users, such as in smart healthcare, smart driving, and robotics. Various quantitative methods have been employed for this purpose, such as physiological and behavioral methods. However, the sensitivity, reliability, and usability are not satisfactory in many of the current methods, so they are not ideal for ubiquitous applications. In this study, we employed a reflected photoplethysmogram-based stress-induced vascular response index, i.e., the reflected sVRI (sVRI-r), to non-invasively measure the cognitive load and stress. This method has high usability as well as good sensitivity and reliability compared with the previously proposed transmitted sVRI (sVRI-t). We developed the basic methodology and detailed algorithm framework to validate the sVRI-r measurements, and it was implemented by employing two light sources, i.e., infrared light and green light. Compared with the simultaneously recorded blood pressure, heart rate variation, and sVRI-t, our findings demonstrated the greater potential of the sVRI-r for use as a sensitive, reliable, and usable parameter, as well as suggesting its potential integration with ubiquitous touch interactions for dynamic cognition and stress-sensing scenarios.

References

[1]

F. Paas, J. E. Tuovinen, H. Tabbers et al. 2003. Cognitive Load measurement as a means to advance cognitive load theory. Edu. Psychol. 38, 1, 63--71.

[2]

J. K. Kiecolt-Glaser, L. McGuire, T. F. Robles et al. 2002. Psychoneuroimmunology: Psychological influences on immune function and health. J. Consult. Clin. Psychol. 70, 3, 537--547.

[3]

H. Sarker, M. Sharmin, A. A. Ali et al. 2014. Assessing the availability of users to engage in just-in-time intervention in the natural environment. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing. 909--920.

Digital Library

[4]

S. Haim, R. Wang, S. E. Lord et al. 2015. The mobile photographic stress meter (MPSM): A new way to measure stress using images. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the ACM International Symposium on Wearable Computers. 733--742.

Digital Library

[5]

J. Healey and R. Picard. 2000. SmartCar: Detecting driver stress. In Proceedings of the International Conference on Pattern Recognition, 214, 218--221.

Digital Library

[6]

H. Lu, D. Frauendorfer, M. Rabbi et al. 2012. StressSense: detecting stress in unconstrained acoustic environments using smartphones. In Proceedings of the ACM Conference on Ubiquitous Computing, 351--360.

Digital Library

[7]

A.-M. Brouwer, M. A. Hogervorst, M. Holewijn et al. 2014. Evidence for effects of task difficulty but not learning on neurophysiological variables associated with effort. Int. J. Psychophysiol. 93. 2, 242--252.

[8]

R. Brunken, J. L. Plass, and D. Leutner. 2003. Direct measurement of cognitive load in multimedia learning. Edu. Psychol. 38(1), 53--61.

[9]

S. Oviatt. 2006. Human-centered design meets cognitive load theory: Designing interfaces that help people think. In Proceedings of the ACM International Conference on Multimedia. 871--880.

Digital Library

[10]

S. G. Hart and L. E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Adv. Psychol. 52, 6, 139--183.

[11]

G. Matthews, S. E. Campbell, S. Falconer et al. 2002. Fundamental dimensions of subjective state in performance settings: Task engagement, distress, and worry. Emotion 2, 4, 315--340.

[12]

W. B. Verwey and H. A. Veltman. 1996. Detecting short periods of elevated workload: A comparison of nine workload assessment techniques. J. Exper. Psychol. Appl. 2, 3, 270--285.

[13]

J. Dennerlein, T. Becker, P. Johnson et al. 2003. Frustrating computers users increases exposure to physical factors. Proceedings of the International Ergonomics Association Seoul Korea.

[14]

Y. Gao, N. Bianchi-Berthouze, and H. Meng. 2012. What does touch tell us about emotions in touchscreen-based gameplay? ACM Trans. Comput.-Hum. Interact. 19, 4, 1--30.

Digital Library

[15]

L. Luo, L. Xiao, D. Miao et al. 2012. The relationship between mental stress induced changes in cortisol levels and vascular responses quantified by waveform analysis: Investigating stress-dependent indices of vascular changes. In Proceedings of the International Conference on Biomedical Engineering and Biotechnology, 929--933.

Digital Library

[16]

F. Bousefsaf, C. Maaoui, and A. Pruski. 2014. Remote detection of mental workload changes using cardiac parameters assessed with a low-cost webcam. Comput. Biol. Med. 53(C), 154.

Digital Library

[17]

H. Chigira, A. Maeda, and M. Kobayashi. 2011. Area-based photo-plethysmographic sensing method for the surfaces of handheld devices. Proceedings of the ACM Symposium on User Interface Software and Technology. 499--508.

Digital Library

[18]

K. S. Yoo and W. H. Lee. 2011. Mental stress assessment based on pulse photoplethysmography. In Proceedings of the IEEE International Symposium on Consumer Electronics. 323--326.

[19]

S. G. Hart and L. E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in Psychology, A. H. Peter and M. Najmedin (Eds.). North-Holland, 139--183.

[20]

W. B. Verwey and H. A. Veltman. 1996. Detecting short periods of elevated workload: A comparison of nine workload assessment techniques. J. Exper. Psychol.: Appl. 2, 3, 270—285.

[21]

G. Matthews, S. E. Campbell, S. Falconer et al. 2002. Fundamental dimensions of subjective state in performance settings: Task engagement, distress, and worry. Emotion 2, 4, 315--340.

[22]

S. D. Kreibig. 2010. Autonomic nervous system activity in emotion: A review. Biol. Psychol. 84, 3, 394--421.

[23]

A.-M. Brouwer, M. A. Hogervorst, J. B. Van Erp et al. 2012. Estimating workload using EEG spectral power and ERPs in the n-back task. J. Neural Eng. 9, 4, 045008.

[24]

L. Luo, L. Xiao, D. Miao et al. 2012. The relationship between mental stress induced changes in cortisol levels and vascular responses quantified by waveform analysis: Investigating stress-dependent indices of vascular changes. In Proceedings of the International Conference on Biomedical Engineering and Biotechnology. IEEE Computer Society, 929--933.

Digital Library

[25]

C. Iani, D. Gopher, and P. Lavie. 2004. Effects of task difficulty and invested mental effort on peripheral vasoconstriction. Psychophysiology 41, 5, 789--798.

[26]

G. G. Berntson, J. T. Cacioppo, and K. S. Quigley. 1991. Autonomic determinism: The modes of autonomic control, the doctrine of autonomic space, and the laws of autonomic constraint. Psychological Review. 98, 4, 459--487.

[27]

J. Hernandez, P. Paredes, A. Roseway et al. 2014. Under pressure: Sensing stress of computer users. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 51--60.

Digital Library

[28]

Y. Lyu, X. Luo, J. Zhou et al. 2015. Measuring photoplethysmogram-based stress-induced vascular response index to assess cognitive load and stress. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 857--866.

Digital Library

[29]

C.-C. Chen, S.-C. Lin, M.-S. Young et al. 2014. Accumulated mental stress study using the meridians of traditional Chinese medicine with photoplethysmography. J. Alt. Comp. Med. 20, 11, 860--867.

[30]

M. P. Fink. 2014. Analyzing the value of monitoring duodenal mucosal perfusion using photoplethysmography. Crit Care. 18, 5, 561.

[31]

T. Tamura, Y. Maeda, M. Sekine et al. 2014. Wearable photoplethysmographic sensors—Past and present. Electronics 3, 2, 282.

[32]

R. Wijshoff, J. Veen, A. M. Van der Lee et al. 2011. PPG motion artifact handling using a self-mixing interferometric sensor. In Proceedings of the 11th Conference on Optical Fibers, Sensors, and Devices for Biomedical Diagnostics and Treatment, SPIE (International Society for Optical Engineering).

[33]

R. W. Wijshoff, M. Mischi, J. Veen et al. 2012. Reducing motion artifacts in photoplethysmograms by using relative sensor motion: Phantom study. J. Biomed. Optics 17, 11, 117007--117007.

[34]

F. E. Ritter, A. L. Reifers, L. C. Klein et al. 2007. Lessons from defining theories of stress for cognitive architectures. Integr. Models Cogn. Syst. 1, 254.

[35]

N. Hjortskov, D. Rissén, A. K. Blangsted et al. 2004. The effect of mental stress on heart rate variability and blood pressure during computer work. Eur. J. Appl. Physiol. 92(1--2), 84--89.

Cited By

Polikarpova ASamochadin A(2023)Development of a System for Calculating the Correlation between Blink Attributes and Attention CharacteristicsCyber-Physical Systems and Control II10.1007/978-3-031-20875-1_36(392-401)Online publication date: 21-Jan-2023
https://doi.org/10.1007/978-3-031-20875-1_36
Thorpe ANesbitt KEidels A(2020)A Systematic Review of Empirical Measures of Workload CapacityACM Transactions on Applied Perception10.1145/342286917:3(1-26)Online publication date: 19-Oct-2020
https://dl.acm.org/doi/10.1145/3422869

Index Terms

Non-Invasive Measurement of Cognitive Load and Stress Based on the Reflected Stress-Induced Vascular Response Index
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Measuring Photoplethysmogram-Based Stress-Induced Vascular Response Index to Assess Cognitive Load and Stress
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Quantitative assessment for cognitive load and mental stress is very important in optimizing human-computer system designs to improve performance and efficiency. Traditional physiological measures, such as heart rate variation (HRV), blood pressure and ...
Morphometric study of stress-induced changes in aortic wall microstructure
BIEN '07: Proceedings of the fifth IASTED International Conference: biomedical engineering

This study investigated quantitatively microstructural changes of the aortic wall, when subjected to different pre-selected stress levels. Measured parameters included content, orientation, and waviness of elastic lamellae and collagen fibers. Light ...
New ways of non-invasive measuring of blood circulation parameters

The purpose of the article is to describe possible ways of non-invasive measuring and analysis of blood circulation parameters. These parameters are very important indicators of various cardiovascular diseases in clinical practice. For this purpose, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Applied Perception

ACM Transactions on Applied Perception Volume 15, Issue 3

July 2018

144 pages

ISSN:1544-3558

EISSN:1544-3965

DOI:10.1145/3208320

Editors:
Victoria Interrante
University of Minnesota, USA
,
Martin Giese
University of Tübingen, Germany

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 2018

Accepted: 01 February 2018

Revised: 01 November 2017

Received: 01 February 2017

Published in TAP Volume 15, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Chinese National Key Research and Development Program
China Scholarship Council
ubihealth
Tsinghua University Initiative Scientific Research Program, the Research Fund from Beijing Innovation Center for Future Chip

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
339
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)2

Reflects downloads up to 06 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Polikarpova ASamochadin A(2023)Development of a System for Calculating the Correlation between Blink Attributes and Attention CharacteristicsCyber-Physical Systems and Control II10.1007/978-3-031-20875-1_36(392-401)Online publication date: 21-Jan-2023
https://doi.org/10.1007/978-3-031-20875-1_36
Thorpe ANesbitt KEidels A(2020)A Systematic Review of Empirical Measures of Workload CapacityACM Transactions on Applied Perception10.1145/342286917:3(1-26)Online publication date: 19-Oct-2020
https://dl.acm.org/doi/10.1145/3422869

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents