Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Browser-Based Game Design for Cognitive Effort Aware Quality of Experience Evaluation

  • Conference paper
  • First Online:
Games and Learning Alliance (GALA 2023)

Abstract

Cognitive effort plays a crucial part in our multimedia consumption experience as it affects attention. However, traditional research in quality of experience (QoE) relies on the subjective ratings of a multimedia consumption experience under a lab-based environment without distractions. To make the collected QoE ratings closer to realistic usage scenarios we designed a browser-based game as an adapted QoE subjective test that can incorporate and quantify cognitive effort using a dual-task paradigm. Our pilot study results show that our proposed browser-based game is a viable protocol that can control for, and reflect, the cognitive effort via selected self-reported measures given an appropriate load range. Future work will further standardise and simplify the game protocol for robustness, repeatability and test duration.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Allport, D.A., Antonis, B., Reynolds, P.: On the division of attention: a disproof of the single channel hypothesis. Quart. J. Experiment. Psychol. 24(2), 225–235 (5 1972). https://doi.org/10.1080/00335557243000102

  2. Leeuw, J.R.: jsPsych: a JavaScript library for creating behavioral experiments in a Web browser. Behavior Research Methods 47(1), 1–12 (2014). https://doi.org/10.3758/s13428-014-0458-y

    Article  Google Scholar 

  3. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Adv. Psychol. 52(C), 139–183 (1988). https://doi.org/10.1016/S0166-4115(08)62386-9

  4. Hunter, C.R.: Tracking cognitive spare capacity during speech perception with eeg/erp: effects of cognitive load and sentence predictability. Ear and Hearing, pp. 1144–1157 (2020). https://doi.org/10.1097/AUD.0000000000000856

  5. ITU-T: P.800: Methods for subjective determination of transmission quality. Tech. rep., Int. Telecomm. Union (1996)

    Google Scholar 

  6. Johnsrude, I.S., Rodd, J.M.: Factors that increase processing demands when listening to speech. in: neurobiology of language, pp. 491–502. Elsevier Inc. (1 2015). https://doi.org/10.1016/B978-0-12-407794-2.00040-7

  7. Kabal, P.: Tsp speech database. McGill University, Database Version 1, 09–02 (2002)

    Google Scholar 

  8. Kahneman, D.: Attention and effort. Prentice-Hall, Inc. (1973)

    Google Scholar 

  9. Lavie, N.: Distracted and confused?: selective attention under load. Trends Cogn. Sci. 9(2) (2005). https://doi.org/10.1016/j.tics.2004.12.004

  10. Murphy, G., Greene, C.M.: Perceptual load induces inattentional blindness in drivers. Appl. Cogn. Psychol. 30(3), 479–483 (2016). https://doi.org/10.1002/acp.3216

    Article  Google Scholar 

  11. Murphy, G., Greene, C.M.: The elephant in the road: auditory perceptual load affects driver perception and awareness. Appl. Cogn. Psychol. 31(2), 258–263 (2017). https://doi.org/10.1002/acp.3311

    Article  Google Scholar 

  12. Peelle, J.E.: Listening effort: how the cognitive consequences of acoustic challenge are reflected in brain and behavior. Ear Hear. 39(2), 204–214 (2018). https://doi.org/10.1097/AUD.0000000000000494

    Article  Google Scholar 

  13. Pichora-Fuller, M.K., et al.: Hearing impairment and cognitive energy: the framework for understanding effortful listening (FUEL). Ear Hear. 37, 5S-27S (2016). https://doi.org/10.1097/AUD.0000000000000312

    Article  Google Scholar 

  14. Sevcenko, N., Ninaus, M., Wortha, F., Moeller, K., Gerjets, P.: Measuring cognitive load using in-game metrics of a serious simulation game. Front. Psychol. 12, 572437 (2021)

    Article  Google Scholar 

  15. Sun, P.W., Hines, A.: Listening effort informed quality of experience evaluation. Computational Neuroscience for Perceptual Quality Assessment (2022)

    Google Scholar 

  16. de Waard, D.: The Measurement of Drivers’ Mental Workload. Ph.D. thesis, University of Groningen (1996). https://doi.org/10.1016/j.apergo.2003.11.009

  17. Zacharov, N.: Sensory evaluation of sound. CRC Press (2018)

    Google Scholar 

Download references

Acknowledgment

Special thanks to Fintan Costello, Markus Vaalgamaa and Xiaolin Mei for the continuous discussions on the experiment design, and David Baker and L-Miao Li for advices on statistical analysis.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pheobe Sun .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sun, P., Santos, F.H., Hines, A. (2024). Browser-Based Game Design for Cognitive Effort Aware Quality of Experience Evaluation. In: Dondio, P., et al. Games and Learning Alliance. GALA 2023. Lecture Notes in Computer Science, vol 14475. Springer, Cham. https://doi.org/10.1007/978-3-031-49065-1_49

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-49065-1_49

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-49064-4

  • Online ISBN: 978-3-031-49065-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics