research-article

Game-based Assessment of Psycho-acoustic Thresholds: Not All Games Are Equal!

Authors:

Vero Vanden Abeele,

Pol Ghesquière,

Luc GeurtsAuthors Info & Claims

CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play

Pages 331 - 341

https://doi.org/10.1145/2793107.2793132

Published: 05 October 2015 Publication History

Abstract

This paper first presents a critical analysis of an existing game (APEX), designed by researchers in psychoacoustics only, to measure psychoacoustic thresholds in preschoolers. Next it presents another game (DIESEL-X), designed by dyslexia researchers and game designers, to remediate the shortcomings of the former game. Via a repeated measures experiment (n = 95), the game experience, attention, and psychoacoustic thresholds are compared. It is shown that the children prefer the game experience of DIESEL-X over APEX. Moreover, the former game was able to measure lower frequency-modulation thresholds than APEX. These results demonstrate that when it comes down to game-based assessment of children's perceptual capabilities, the quality of game design not only has an effect on game experience, but equally on the scientific measurements obtained via such a game-based assessment.

References

[1]

Peter J Bailey and Margaret J Snowling. 2002. Auditory processing and the development of language and literacy. Br Med Bull 63, 1, 135--146. http://doi.org/10.1093/bmb/63.1.135

[2]

Albert Bandura and Edwin A. Locke. 2003. Negative self-efficacy and goal effects revisited. Journal of applied psychology 88, 1, 87.

[3]

Roy F. Baumeister, Ellen Bratslavsky, Catrin Finkenauer, and Kathleen D. Vohs. 2001. Bad is stronger than good. Review of general psychology 5, 4, 323.

[4]

Wendy L. Bedwell, Davin Pavlas, Kyle Heyne, Elizabeth H. Lazzara, and Eduardo Salas. 2012. Toward a Taxonomy Linking Game Attributes to Learning: An Empirical Study. Simulation & Gaming, 1046878112439444. http://doi.org/10.1177/1046878112439444

Digital Library

[5]

Bart Boets, Pol Ghesquière, Astrid van Wieringen, and Jan Wouters. 2007. Speech perception in preschoolers at family risk for dyslexia: Relations with low-level auditory processing and phonological ability. Brain and Language 101, 1, 19--30. http://doi.org/10.1016/j.bandl.2006.06.009

[6]

Bart Boets, Jan Wouters, Astrid van Wieringen, B Desmedt, and Pol Ghesquière. 2008. Modelling relations between sensory processing, speech perception, orthographic and phonological ability, and literacy achievement. Brain and Language 106, 1, 29--40. http://doi.org/10.1016/j.bandl.2007.12.004

[7]

Bart Boets, Jan Wouters, Astrid van Wieringen, and Pol Ghesquière. 2006. Auditory temporal information processing in preschool children at family risk for dyslexia: Relations with phonological abilities and developing literacy skills. Brain and Language 97, 1, 64--79. http://doi.org/10.1016/j.bandl.2005.07.026

[8]

Bart Boets, Jan Wouters, Astrid van Wieringen, and Pol Ghesquière. 2006. Coherent motion detection in preschool children at family risk for dyslexia. Vision Research 46, 4, 527--535. http://doi.org/10.1016/j.visres.2005.08.023

[9]

Bart Boets. 2006. Early literacy development in children at risk for dyslexia. A longitudinal study of the general magnocellular theory.

[10]

L. Bradley and P. E. Bryant. 1983. Categorizing sounds and learning to read: a causal connection. Nature 301, 5899, 419--421. http://doi.org/10.1038/301419a0

[11]

Amy Bruckman. 1999. Can educational be fun? Game Developers Conference '99.

[12]

Véronique Celis, Jelle Husson, Vero Vanden Abeele, et al. 2013. Translating preschoolers' game experiences into design guidelines via a laddering study. Proceedings of the 12th International Conference on Interaction Design and Children, ACM, 147--156. http://doi.org/10.1145/2485760.2485772

Digital Library

[13]

Diana I. Cordova and Mark R. Lepper. 1996. Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of educational psychology 88, 4, 715.

[14]

Mihaly Csikszentmihalyi. 1990. Flow: The Psychology of Optimal Experience. Harper and Row, New York.

[15]

E. L. Deci and R. M. Ryan. 1985. Intrinsic motivation and self-determination in human behavior. Springer.

[16]

M. E. Farmer and R. M. Klein. 1995. The evidence for a temporal processing deficit linked to dyslexia: A Review. Psychonomic bulletin & review 2, 4, 460--493.

[17]

Angela Fawcett and Rod Nicolson. 1995. Dyslexia in Children: Multidisciplinary Perspectives. Harvester Wheatsheaf.

[18]

Rosemary Garris, Robert Ahlers, and James E. Driskell. 2002. Games, Motivation, and Learning: A Research and Practice Model. Simulation & Gaming 33, 4, 441-- 467. http://doi.org/10.1177/1046878102238607

[19]

D. C. M. Gersons-Wolfensberger and Wied A. J. J. M. Ruijssenaars. 1997. Definition and Treatment of Dyslexia: A Report by the Committee on Dyslexia of the Health Council of the Netherlands. Journal of Learning Disabilities 30, 2, 209--13.

[20]

Luc Geurts, Vero Vanden Abeele, Véronique Celis, et al. 2015. DIESEL-X: A game-based tool for early risk detection of dyslexia in preschoolers. In Describing and Studying Domain-Specific Serious Games, Joke Torbeyns, Erno Lehtinen and Jan Elen (eds.). Springer.

[21]

M. P. Jacob Habgood and Shaaron E. Ainsworth. 2011. Motivating Children to Learn Effectively: Exploring the Value of Intrinsic Integration in Educational Games. Journal of the Learning Sciences 20, 2, 169--206. http://doi.org/10.1080/10508406.2010.508029

[22]

Sini Hintikka, Aro Mikko, and Lyytinen, Heikki. 2005. Computerized training of the correspondences between phonological and orthographic units. Written Language and Literacy 8, 2, 79--102.

[23]

Wijnand IJsselsteijn, Yvonne A.W. de Kort, Karolien Poels, Audrius Jurgelionis, and Victoria Bellotti. 2007. Characterising and Measuring User Experiences in Digital Games. ACM Press.

[24]

Peter F. de Jong. 1995. Assessment of attention: Further validation of the star counting test. European Journal of Psychological Assessment 11, 2, 89--97. http://doi.org/10.1027/1015-5759.11.2.89

[25]

Johan Laneau, Bart Boets, Marc Moonen, Astrid van Wieringen, and Jan Wouters. 2005. A flexible auditory research platform using acoustic or electric stimuli for adults and young children. Journal of Neuroscience Methods 142, 1, 131--136. http://doi.org/10.1016/j.jneumeth.2004.08.015

[26]

Nicole Lazarro. 2004. Why We Play Games: Four Keys to More Emotion Without Story. XEO design. Retrieved March 1, 2009 from http://www.xeodesign.com/whyweplaygames/xeodesig n_whyweplaygames.pdf

[27]

Dianne L. Lefly and Bruce F. Pennington. 1991. Spelling Errors and Reading Fluency in Compensated Adult Dyslexics. Annals of Dyslexia 41, 143--62.

[28]

H. Levitt. 1971. Transformed up-down methods in psychoacoustics. The Journal of the Acoustical society of America 49, 2B, 467--477.

[29]

A. Locke and G. Latham. 1989. A Theory of Goal Setting and Task Performance. Prentice-Hall.

[30]

Heikki Lyytinen and Jane Erskine. 2006. Early Identification and Prevention of Reading Problems. Encyclopedia on Early Childhood Development. Retrieved from http://www.enfantencyclopedie.com/Pages/PDF/LyytinenErskineANGxp.pdf

[31]

Thomas W. Malone and M. R. Lepper. 1987. Making learning fun: A taxonomy of intrinsic motivations for learning. Aptitude, learning, and instruction 3, 223-- 253.

[32]

G. M. McArthur and D. V. Bishop. 2001. Auditory perceptual processing in people with reading and oral language impairments: current issues and recommendations. Dyslexia (Chichester, England) 7, 3, 150--170. http://doi.org/10.1002/dys.200

[33]

E. McAuley, T. Duncan, and V. V. Tammen. 1989. Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: a confirmatory factor analysis. Research quarterly for exercise and sport 60, 1, 48.

[34]

Peter Menell, Ken I. McAnally, and John Stein. 1999. Psychophysical Sensitivity and Physiological Response to Amplitude Modulation in Adult Dyslexic Listeners. J Speech Lang Hear Res 42, 4, 797--803.

[35]

Dario Di Nocera, Alberto Finzi, Silvia Rossi, and Mariacarla Staffa. 2014. The role of intrinsic motivations in attention allocation and shifting. Frontiers in Psychology 5. http://doi.org/10.3389/fpsyg.2014.00273

[36]

Louise E. Parker and Mark R. Lepper. 1992. Effects of fantasy contexts on children's learning and motivation: Making learning more fun. Journal of Personality and Social Psychology 62, 4, 625.

[37]

Michael I. Posner. 1980. Orienting of attention. Quarterly journal of experimental psychology 32, 1, 3--25.

[38]

J. C. Read, S. J. MacFarlane, and Chris Casey. 2002. Endurability, engagement and expectations: Measuring children's fun. Interaction design and children, Shaker Publishing Eindhoven, 1--23. Retrieved April 5, 2015 from http://chici.org/references/endurability_engagement.pdf

[39]

Janet C. Read. 2008. Validating the Fun Toolkit: An Instrument for Measuring Children's Opinions of Technology. Cogn. Technol. Work 10, 2, 119--128. http://doi.org/10.1007/s10111-007-0069-9

Digital Library

[40]

Katrina E. Ricci, Eduardo Salas, and Janis A. CannonBowers. 1996. Do computer-based games facilitate knowledge acquisition and retention? Military Psychology 8, 4, 295--307. http://doi.org/10.1207/s15327876mp0804_3

[41]

Lucy J. Robinson, Lucy H. Stevens, Christopher J. D. Threapleton, Jurgita Vainiute, R. Hamish McAllisterWilliams, and Peter Gallagher. 2012. Effects of intrinsic and extrinsic motivation on attention and memory. Acta Psychologica 141, 2, 243--249. http://doi.org/10.1016/j.actpsy.2012.05.012

[42]

Paul Rozin and Edward B. Royzman. 2001. Negativity Bias, Negativity Dominance, and Contagion. Personality and Social Psychology Review 5, 4, 296--320. http://doi.org/10.1207/S15327957PSPR0504_2

[43]

Sally E. Shaywitz. 1998. Dyslexia. New England Journal of Medicine 338, 5, 307--312. http://doi.org/10.1056/NEJM199801293380507

[44]

Gavin Sim and Matthew Horton. 2012. Investigating Children's Opinions of Games: Fun Toolkit vs. This or That. Proceedings of the 11th International Conference on Interaction Design and Children, ACM, 70--77. http://doi.org/10.1145/2307096.2307105

Digital Library

[45]

Margaret J. Snowling. 2000. Dyslexia. Wiley Blackwell.

[46]

J.B. Talcott, C. Witton, M F McLean, et al. 2000. Dynamic sensory sensitivity and children's word decoding skills. Proceedings of the National Academy of Sciences of the United States of America 97, 6, 2952--2957. http://doi.org/10.1073/pnas.040546597

[47]

J.B. Talcott and C. Witton. 2002. A sensory linguistic approach to the development of normal and impaired reading skills. In Neuropsychology and cognition series. Basic functions of language and language disorders. Dordrecht, Netherlands: Kluwer Academic Publishers.

[48]

Ed S. Tan and Jeroen Jansz. 2007. The Game Experience. Product Experience.

[49]

Vero Vanden Abeele, Bob De Schutter, Luc Geurts, et al. 2012. P-III: A Player-Centered, Iterative, Interdisciplinary and Integrated Framework for Serious Game Design and Development. In Serious Games: The Challenge, Stefan Wannemacker, Sylke Vandercruysse and Geraldine Clarebout (eds.). Springer Berlin Heidelberg, 82--86. Retrieved October 9, 2012 from http://www.springerlink.com/content/k66727215741j3t0/abstract/

[50]

C. Witton, J.B. Talcott, P C Hansen, et al. 1998. Sensitivity to dynamic auditory and visual stimuli predicts nonword reading ability in both dyslexic and normal readers. Current Biology: CB 8, 14, 791--797.

[51]

Wolfshead. 2007. Bushnell's Theorem: Easy to Learn, Difficult to Master | Wolfshead Online. Retrieved April 8, 2010 from http://www.wolfsheadonline.com/?p=81#291dc

[52]

Bieke Zaman, Vero Vanden Abeele, and Dirk De Grooff. 2013. Measuring product liking in preschool children: An evaluation of the Smileyometer and This or That methods. International Journal of ChildComputer Interaction 1, 2, 61--70. http://doi.org/10.1016/j.ijcci.2012.12.001

[53]

Bieke Zaman, Vero Vanden Abeele, and Dirk De Grooff. 2013. Measuring product liking in preschool children: An evaluation of the Smileyometer and This or That methods. International Journal of ChildComputer Interaction 1, 2, 61--70. http://doi.org/10.1016/j.ijcci.2012.12.001

[54]

Bieke Zaman and Vero Vanden Abeele. 2007. How to Measure the Likeability of Tangible Interaction with Preschoolers. Proceedings of CHI.NL, Infotec Nederland BV Woerden, 57--59. Retrieved March 20, 2009 from http://soc.kuleuven.be/com/mediac/cuo/admin/upload/ Zaman_Abeele_chiformat.pdf

[55]

Bieke Zaman. 2009. Introducing a Pairwise Comparison Scale for UX Evaluations with Preschoolers. In HumanComputer Interaction -- INTERACT 2009. 634--637. Retrieved October 6, 2009 from http://dx.doi.org/10.1007/978-3-642-03658-3_68

Digital Library

Cited By

Wiley KBerger PFriehs MMandryk R(2024)Measuring the Reliability of a Gamified Stroop Task: Quantitative ExperimentJMIR Serious Games10.2196/5031512(e50315)Online publication date: 10-Apr-2024
https://doi.org/10.2196/50315
Tyack AMekler E(2024)Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned ParadigmsACM Transactions on Computer-Human Interaction10.1145/367323031:3(1-74)Online publication date: 15-Jun-2024
https://dl.acm.org/doi/10.1145/3673230
Zhou SHendra LZhang QHolopainen JLC R(2024)Eternagram: Probing Player Attitudes Towards Climate Change Using a ChatGPT-driven Text-based AdventureProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642850(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642850
Show More Cited By

Index Terms

Game-based Assessment of Psycho-acoustic Thresholds: Not All Games Are Equal!
1. Human-centered computing

Recommendations

The interplay of game elements with psychometric qualities, learning, and enjoyment in game-based assessment

Educators today are increasingly interested in using game-based assessment to assess and support students' learning. In the present study, we investigated how changing a game design element, linearity in gameplay sequences, influenced the effectiveness ...
An online chess game designed for people with dyslexia
W4A '16: Proceedings of the 13th International Web for All Conference

Teaching chess to students with learning disabilities has been shown to benefit their school performance in unrelated domains. At the same time, chess involves skills that are highly correlated with dyslexia, such as visuospatial and calculation ...
Impacts of Forced Serious Game Play on Vulnerable Subgroups

Three vulnerable subgroups of players non-gamers, resistant players, and females were studied to understand how each approaches and plays serious games. The authors explore forced required play using four different online casual games. Their research ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play

October 2015

852 pages

ISBN:9781450334662

DOI:10.1145/2793107

General Chairs:
Anna L. Cox
University College London, UK
,
Paul Cairns
University of York, UK
,
Program Chairs:
Regina Bernhaupt
IRIT, France
,
Lennart Nacke
University of Waterloo, Canada

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

IWT

Conference

CHI PLAY '15

Sponsor:

SIGCHI

CHI PLAY '15: The annual symposium on Computer-Human Interaction in Play

October 5 - 7, 2015

London, United Kingdom

Acceptance Rates

CHI PLAY '15 Paper Acceptance Rate 40 of 144 submissions, 28%;

Overall Acceptance Rate 421 of 1,386 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
285
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wiley KBerger PFriehs MMandryk R(2024)Measuring the Reliability of a Gamified Stroop Task: Quantitative ExperimentJMIR Serious Games10.2196/5031512(e50315)Online publication date: 10-Apr-2024
https://doi.org/10.2196/50315
Tyack AMekler E(2024)Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned ParadigmsACM Transactions on Computer-Human Interaction10.1145/367323031:3(1-74)Online publication date: 15-Jun-2024
https://dl.acm.org/doi/10.1145/3673230
Zhou SHendra LZhang QHolopainen JLC R(2024)Eternagram: Probing Player Attitudes Towards Climate Change Using a ChatGPT-driven Text-based AdventureProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642850(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642850
Gomez MRuipérez-Valiente JClemente F(2023)A Systematic Literature Review of Game-Based Assessment Studies: Trends and ChallengesIEEE Transactions on Learning Technologies10.1109/TLT.2022.322666116:4(500-515)Online publication date: Aug-2023
https://doi.org/10.1109/TLT.2022.3226661
Cutting JIacovides I(2022)Learning by Doing: Intrinsic Integration Directs Attention to Increase Learning In GamesProceedings of the ACM on Human-Computer Interaction10.1145/35495036:CHI PLAY(1-18)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3549503
Sarsenbayeva ZVan Berkel NVelloso EGoncalves JKostakos V(2022)Methodological Standards in Accessibility Research on Motor Impairments: A SurveyACM Computing Surveys10.1145/354350955:7(1-35)Online publication date: 15-Dec-2022
https://dl.acm.org/doi/10.1145/3543509
Kosoris NLiu BFain B(2022)A Framework for XReality Serious GamesSoutheastCon 202210.1109/SoutheastCon48659.2022.9764129(793-798)Online publication date: 26-Mar-2022
https://doi.org/10.1109/SoutheastCon48659.2022.9764129
Wiley KRobinson RMandryk R(2021)The Making and Evaluation of Digital Games Used for the Assessment of Attention: Systematic ReviewJMIR Serious Games10.2196/264499:3(e26449)Online publication date: 9-Aug-2021
https://doi.org/10.2196/26449
Johannes Dechant MFrommel JMandryk RKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Assessing Social Anxiety Through Digital Biomarkers Embedded in a Gaming TaskProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445238(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445238
Smets Jvan der Spek E(2021)That Sound’s Juicy! Exploring Juicy Audio Effects in Video GamesEntertainment Computing – ICEC 202110.1007/978-3-030-89394-1_24(319-335)Online publication date: 2-Nov-2021
https://dl.acm.org/doi/10.1007/978-3-030-89394-1_24
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents