research-article

Exploring motion-based touchless games for autistic children's learning

Authors:

Franca Garzotto,

Matteo ValorianiAuthors Info & Claims

IDC '13: Proceedings of the 12th International Conference on Interaction Design and Children

Pages 102 - 111

https://doi.org/10.1145/2485760.2485774

Published: 24 June 2013 Publication History

Abstract

Our understanding of the effectiveness of motion-based touchless games for autistic children is limited, because of the small amount of empirical studies and the limits of our current knowledge on autism. This paper offers two contributions. First, we provide a survey and a discussion of the existing literature. Second, we describe a field study that extends the current body of empirical evidence of the potential benefits of touchless motion-based gaming for autistic children. Our research involved five autistic children and one therapist in the experimentation of a set of Kinect games at a therapeutic center for a period of two and a half months. Using standardized therapeutic tests, observations during game sessions, and video analysis of over 20 hours of children's activities, we evaluated the learning benefits in relationship to attentional skills and explored several factors in the emotional and behavioral sphere. Our findings show improvements of the considered learning variables and help us to better understand how autistic children experience motion-based touchless play. Overall, our research sheds a light on the opportunities offered full body touchless games for therapy and education of these special users.

References

[1]

Bianchi-Berthouze, N., Kim, W., & Patel, D. 2007. Does body movement engage you more in digital game play? And Why? Affective Computing and Intelligent Interaction, 102--113. Springer.

Digital Library

[2]

Blum-Dimaya, A., Reeve, S. A., Reeve, K. F., & Hoch, H. 2010. Teaching children with autism to play a video game using activity schedules and game-embedded simultaneous video modeling. Education and Treatment of Children, 33(3), 2010, 351--370

[3]

Brickenkamp, R., Zillmer, E. 1998. The d2 test of attention. Hogrefe & Huber Pub.

[4]

Broaders S. C., Cook S. W., Mitchell, Z., Goldin-Meadow, S. 2007. Making children gesture brings out implicit knowledge and leads to learning. J. Experimental Psychology 136 (4), 2007, 539--550.

[5]

Casas X., Herrera G., Coma, I., Fernandez M. 2012. A kinect-based augmented reality system for individuals with autism spectrum disorders. Proc. GRAPP/IVAPP 2012,: 240--246, SciTePress

[6]

Charlton B., Williams R. L., McLaughlin, T. F. 2005. Educational games: A technique to accelerate the acquisition of reading skills of children with learning disabilities. Int. Journal of Special Education, 20 (2), 2005. 66--72.

[7]

Chia N. K. H., Li, J. 2012. Design of a generic questionnaire for reflective evaluation of a virtual reality-based intervention using virtual dolphins for children with autism. Int. J. Special Education, 27 (3), 2012, 1--9.

[8]

Dourish, P. 2004. Where the action is: the foundations of embodied interaction. MIT press.

[9]

Evans, M. 2012. Gestural Interfaces in Learning. Proc. Society for Information Technology & Teacher Education International Conference 2012, 3337--3340), AACE.

[10]

Ferrari E., Robins E., Dautenhahn K. 2009. Therapeutic and educational objectives in robot assisted play for children with autism. Proc. RO-MAN 2009, 108--114, IEEE

[11]

Gauthier L, Dehaut F, Joanette Y 1989. The bells test: A quantitative and qualitative test for visual neglect. Int. J. of Clinical Neuropsychology, 11, 49--54.

[12]

Grandhi, S. A., Joue, G, Mittelberg, I. 2011. Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces. Proc. CHI 2011, 821--824. ACM.

Digital Library

[13]

Henderson, S. E., Sugden, D. A, Barnett, A. 2007. Movement Assessment Battery for Children. London: Pearson.

[14]

Hoque M. E., Lane J. K., El Kaliouby R., Goodwin M., Picard, R. W. 2009. Exploring speech therapy games with children on the autism spectrum. Proc. INTERSPEECH 2009, 1455--1458,ISCA

[15]

http://lakesideautismblog.wordpress.com/

[16]

http://software.intel.com/en-us/vcsource/tools/perceptual-computing-sdk

[17]

http://www.microsoft.com/en-us/kinectforwindows/

[18]

http://www.ntu.ac.uk/apps/news 109137-22/Computer_games_could_help_people_with_learning_difficulties_to_master_every.aspx.

[19]

http://www.spectronicsinoz.com/product/reactickles

[20]

Hourcade, J. P., Bullock-Rest, N. E., Hansen, T. E. 2012. Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders. Personal and ubiquitous computing, 16 (2), 2012, 157--168. Springer-Verlag.

Digital Library

[21]

Hsu, H. M. J. 2011. The Potential of Kinect as Interactive Educational Technology. Proc. 2nd Int. Conf. on Education and Management Technology, 334--338. IACSIT Press.

[22]

Jordan R. 2003. Social play and autistic spectrum disorders A perspective on theory, implications and educational approaches. Autism, 7 (4), 2003, 347--360. SAGE

[23]

Kandroudi M., Bratitsis T. 2012. Exploring the Educational Perspectives of XBOX Kinect Based Video Games. Proc.ECGBL 2012, 219--227. ACPI

[24]

Kaliouby R., Robinson, P. 2005. The Emotional Hearing Aid: an Assistive Tool for Children with Asperger Syndrome. Universal Access in the Information Society, 4 (2), 121--134.

Digital Library

[25]

Keay-Bright W., Howarth I., Is simplicity the key to engagement for children on the autism spectrum? Personal and Ubiquitous Computing, 16 (2), 2012, 129--141. Springer-Verlag

Digital Library

[26]

Kynigos, C., Smyrnaiou, Z., Roussou, M. 2010. Exploring rules and underlying concepts while engaged with collaborative full-body games. Proc. IDC 2010, 222--225. ACM.

Digital Library

[27]

Lee W. J., Huang C. W., Wu C. J., Huang S. T., Chen G. D. 2012. The Effects of Using Embodied Interactions to Improve Learning Performance. Proc. ICALT 2012, 557--559. IEEE

Digital Library

[28]

Light J., McNaughton D. 2012. Supporting the Communication, Language, and Literacy Development of Children with Complex Communication Needs: State of the Science and Future Research Priorities. Assistive Technology, 24, 2012, 34--44.

[29]

Lo J. L., Lin T. Y., Chu H. H., Chou H. C., Chen J. H., Hsu J., Huang P. 2007. Playful tray: Adopting Ubicomp and persuasive techniques into play-based occupational therapy for reducing poor eating behavior in young children. Proc. UbiComp 2007, 35--55. Springer Berlin Heidelberg.

Digital Library

[30]

Murray D., Lesser M., Lawson W. 2005. Attention, monotropism and the diagnostic criteria for autism. Autism, 9 (2), 139--156. SAGE.

[31]

Nielsen M., Störring, M., Moeslund, T., Granum E. 2004. A procedure for developing intuitive and ergonomic gesture interfaces for HCI. Gesture-Based Communication in HCI, 105--106. Springer.

[32]

Pares N., Masri P. van Wolferen, G., Creed C. 2005. Achieving dialogue with children with severe autism in an adaptive multisensory interaction: the "MEDIATE" project. IEEE Trans. Visualization and Computer Graphics, 11, 734--743. IEEE.

Digital Library

[33]

Parsons S., Mitchell P. 2002. The potential of virtual reality in social skills training for people with autistic spectrum disorders. J. of Intellectual Disability Research, 46 (5), 430--443. Blackwell.

[34]

Parsons S., Leonard A., Mitchell, P. 2006. Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder. Computers and Education 47 (2006) 186--206

Digital Library

[35]

Pirani E., Kolte, M. (2010). Gesture Based Educational Software for Children with Acquired Brain Injuries. Int. J. On Computer Science & Engineering, 1(3), 790--794.

[36]

Rutter M. 1978. Diagnosis and definition of childhood autism. J. Autism and Childhood Schizophrenia, 8(2), 1978, 139--161. Kluwer

[37]

Schell, J. 2008. The art of game design: A book of lenses. Burlington, MA, Morgan Kaufmann

Digital Library

[38]

Shamsuddin, S., Yussof, H., Ismail, L., Hanapiah, F. A., Mohamed, S., Piah, H. A. 2012. Initial response of autistic children in human-robot interaction therapy with humanoid robot. Proc. CSPA 2012, 188--193. IEEE

[39]

Sitdhisanguan K., Chotikakamthorn N., Dechaboon A., Out, P. 2008. Evaluation the efficacy of computer-based training using tangible user interface for low-function children with Autism. Proc. Digital Games & Intelligent Toys Based Education 2008, 70--74. IEEE

Digital Library

[40]

Sylva K., Jolly A., Bruner, J. S. 1976. Play: its role in development and evolution. Penguin.

[41]

Van Zomeren, A. H., Brouwer, W. H. 1994. Clinical neuropsychology of attention. Oxford University Press.

[42]

Villaroman, N., Rowe, D., Swan, B. 2011. Teaching natural user interaction using OpenNI and the Microsoft Kinect Sensor. Proc. SIGITE 2011, 227--232. ACM

Digital Library

[43]

Westeyn T. L., Abowd G. D., Starner T. E., Johnson, J. M., Presti, P. W., Weaver, K. A. 2012. Monitoring children's developmental progress using augmented toys and activity recognition. Personal and Ubiquitous Computing, 16 (2), 2012, 169--191. Springer-Verlag.

Digital Library

[44]

Wilson, M. 2002. Six views of embodied cognition. Psychonomic Bulletin & Review, 9, 625--636. Springer-Verlag.

Cited By

Baughan AFu YIzenman ESchwamm SAlsabeh DPowell NHunt ERich MBickham DRadesky JHiniker A(2024)Investigating Attention and Normative Dissociation in Children's Social Video GamesProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655808(30-43)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655808
Aloizou VLinardatou SBoloudakis MRetalis S(2024)Integrating a movement‐based learning platform as core curriculum tool in kindergarten classroomsBritish Journal of Educational Technology10.1111/bjet.13511Online publication date: 31-Jul-2024
https://doi.org/10.1111/bjet.13511
Sharma KGiannakos M(2024)Carry-forward effect: providing proactive scaffolding to learning processesBehaviour & Information Technology10.1080/0144929X.2024.2411592(1-40)Online publication date: 16-Oct-2024
https://doi.org/10.1080/0144929X.2024.2411592
Show More Cited By

Index Terms

Exploring motion-based touchless games for autistic children's learning

Recommendations

Motion-based touchless interaction for ASD children: a case study
AVI '14: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces

Autism spectrum disorder (ASD) has become the fastest growing disability in the United States in 2013. The disorder is characterized by a triad of symptoms related to lack of social interaction, deficits in the acquisition and expression of language, ...
Designing and evaluating touchless playful interaction for ASD children
IDC '14: Proceedings of the 2014 conference on Interaction design and children

Limited studies exist that explore motionbased touchless applications for children with ASD (Autism Spectrum Disorder) and investigate their design issues and the benefits they can bring to this target group. The paper reports a structured set of design ...
Analysis and prediction of autistic children's game characteristics

Children with autism show great defects in the games they play. This research designed 'CePingBiao of autistic children's game ability', and undertook a study on the game features of 130 children diagnosed with autism, and gave 69 children rehabilitation ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IDC '13: Proceedings of the 12th International Conference on Interaction Design and Children

June 2013

687 pages

ISBN:9781450319188

DOI:10.1145/2485760

Co-chair:
Juan Pablo Hourcade
University of Iowa
,
Conference Chairs:
Nitin Sawhney
The New School
,
Emily Reardon
Sesame Workshop

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

The New School: The New School
ACM: Association for Computing Machinery
Sesame Workshop: Sesame Workshop

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Sixth Framework Programme

Conference

IDC '13

Sponsor:

The New School
ACM
Sesame Workshop

IDC '13: Interaction Design and Children 2013

June 24 - 27, 2013

New York, New York, USA

Acceptance Rates

Overall Acceptance Rate 172 of 578 submissions, 30%

Upcoming Conference

IDC '25

Sponsor:
sigchi

Interaction Design and Children

June 23 - 26, 2025

Reykjavik , Iceland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

97
Total Citations
View Citations
1,713
Total Downloads

Downloads (Last 12 months)69
Downloads (Last 6 weeks)5

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Baughan AFu YIzenman ESchwamm SAlsabeh DPowell NHunt ERich MBickham DRadesky JHiniker A(2024)Investigating Attention and Normative Dissociation in Children's Social Video GamesProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655808(30-43)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655808
Aloizou VLinardatou SBoloudakis MRetalis S(2024)Integrating a movement‐based learning platform as core curriculum tool in kindergarten classroomsBritish Journal of Educational Technology10.1111/bjet.13511Online publication date: 31-Jul-2024
https://doi.org/10.1111/bjet.13511
Sharma KGiannakos M(2024)Carry-forward effect: providing proactive scaffolding to learning processesBehaviour & Information Technology10.1080/0144929X.2024.2411592(1-40)Online publication date: 16-Oct-2024
https://doi.org/10.1080/0144929X.2024.2411592
Pandya SJain SVerma J(2024)A comprehensive analysis towards exploring the promises of AI-related approaches in autism researchComputers in Biology and Medicine10.1016/j.compbiomed.2023.107801168(107801)Online publication date: Jan-2024
https://doi.org/10.1016/j.compbiomed.2023.107801
Tikkanen RIivari NPaananen P(2023)Play—An essential part of children’s lives and their computational empowermentFrontiers in Education10.3389/feduc.2022.10887167Online publication date: 21-Feb-2023
https://doi.org/10.3389/feduc.2022.1088716
李娜(2023)Application of Digital Therapy in Children with Autism Spectrum DisorderAdvances in Psychology10.12677/AP.2023.131165513:11(5189-5197)Online publication date: 2023
https://doi.org/10.12677/AP.2023.1311655
Yu QYu K(2023)Does Motion-Sensing Technology Enhance Students’ Learning? A Meta-AnalysisJournal of Educational Computing Research10.1177/0735633123117674161:7(1359-1388)Online publication date: 29-May-2023
https://doi.org/10.1177/07356331231176741
İNCİ GKÖSE H(2023)The Landscape of Technology Research in Special Education: A Bibliometric AnalysisJournal of Special Education Technology10.1177/0162643423118058239:1(94-107)Online publication date: 15-Jun-2023
https://doi.org/10.1177/01626434231180582
Cosentino GGiannakos M(2023)Multisensory Interaction and Analytics to Enhance Smart Learning Environments: A Systematic Literature ReviewIEEE Transactions on Learning Technologies10.1109/TLT.2023.324321016:3_Part_2(414-430)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1109/TLT.2023.3243210
Baykal GEriksson ETorgersson O(2023)Assessment of learning in child–computer interaction researchInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10057836:COnline publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100578
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten