Abstract
Cognitive effort plays a crucial part in our multimedia consumption experience as it affects attention. However, traditional research in quality of experience (QoE) relies on the subjective ratings of a multimedia consumption experience under a lab-based environment without distractions. To make the collected QoE ratings closer to realistic usage scenarios we designed a browser-based game as an adapted QoE subjective test that can incorporate and quantify cognitive effort using a dual-task paradigm. Our pilot study results show that our proposed browser-based game is a viable protocol that can control for, and reflect, the cognitive effort via selected self-reported measures given an appropriate load range. Future work will further standardise and simplify the game protocol for robustness, repeatability and test duration.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Allport, D.A., Antonis, B., Reynolds, P.: On the division of attention: a disproof of the single channel hypothesis. Quart. J. Experiment. Psychol. 24(2), 225–235 (5 1972). https://doi.org/10.1080/00335557243000102
Leeuw, J.R.: jsPsych: a JavaScript library for creating behavioral experiments in a Web browser. Behavior Research Methods 47(1), 1–12 (2014). https://doi.org/10.3758/s13428-014-0458-y
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Adv. Psychol. 52(C), 139–183 (1988). https://doi.org/10.1016/S0166-4115(08)62386-9
Hunter, C.R.: Tracking cognitive spare capacity during speech perception with eeg/erp: effects of cognitive load and sentence predictability. Ear and Hearing, pp. 1144–1157 (2020). https://doi.org/10.1097/AUD.0000000000000856
ITU-T: P.800: Methods for subjective determination of transmission quality. Tech. rep., Int. Telecomm. Union (1996)
Johnsrude, I.S., Rodd, J.M.: Factors that increase processing demands when listening to speech. in: neurobiology of language, pp. 491–502. Elsevier Inc. (1 2015). https://doi.org/10.1016/B978-0-12-407794-2.00040-7
Kabal, P.: Tsp speech database. McGill University, Database Version 1, 09–02 (2002)
Kahneman, D.: Attention and effort. Prentice-Hall, Inc. (1973)
Lavie, N.: Distracted and confused?: selective attention under load. Trends Cogn. Sci. 9(2) (2005). https://doi.org/10.1016/j.tics.2004.12.004
Murphy, G., Greene, C.M.: Perceptual load induces inattentional blindness in drivers. Appl. Cogn. Psychol. 30(3), 479–483 (2016). https://doi.org/10.1002/acp.3216
Murphy, G., Greene, C.M.: The elephant in the road: auditory perceptual load affects driver perception and awareness. Appl. Cogn. Psychol. 31(2), 258–263 (2017). https://doi.org/10.1002/acp.3311
Peelle, J.E.: Listening effort: how the cognitive consequences of acoustic challenge are reflected in brain and behavior. Ear Hear. 39(2), 204–214 (2018). https://doi.org/10.1097/AUD.0000000000000494
Pichora-Fuller, M.K., et al.: Hearing impairment and cognitive energy: the framework for understanding effortful listening (FUEL). Ear Hear. 37, 5S-27S (2016). https://doi.org/10.1097/AUD.0000000000000312
Sevcenko, N., Ninaus, M., Wortha, F., Moeller, K., Gerjets, P.: Measuring cognitive load using in-game metrics of a serious simulation game. Front. Psychol. 12, 572437 (2021)
Sun, P.W., Hines, A.: Listening effort informed quality of experience evaluation. Computational Neuroscience for Perceptual Quality Assessment (2022)
de Waard, D.: The Measurement of Drivers’ Mental Workload. Ph.D. thesis, University of Groningen (1996). https://doi.org/10.1016/j.apergo.2003.11.009
Zacharov, N.: Sensory evaluation of sound. CRC Press (2018)
Acknowledgment
Special thanks to Fintan Costello, Markus Vaalgamaa and Xiaolin Mei for the continuous discussions on the experiment design, and David Baker and L-Miao Li for advices on statistical analysis.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sun, P., Santos, F.H., Hines, A. (2024). Browser-Based Game Design for Cognitive Effort Aware Quality of Experience Evaluation. In: Dondio, P., et al. Games and Learning Alliance. GALA 2023. Lecture Notes in Computer Science, vol 14475. Springer, Cham. https://doi.org/10.1007/978-3-031-49065-1_49
Download citation
DOI: https://doi.org/10.1007/978-3-031-49065-1_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-49064-4
Online ISBN: 978-3-031-49065-1
eBook Packages: Computer ScienceComputer Science (R0)