research-article

Can you CopyMe?: an expression mimicking serious game

Authors:

Chek Tien Tan,

Natalie Harrold,

Daniel RosserAuthors Info & Claims

SA '13: SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications

Article No.: 73, Pages 1 - 4

https://doi.org/10.1145/2543651.2543657

Published: 19 November 2013 Publication History

Get Access

Abstract

Emotional development is an important aspect in the early years of growth in young children, especially those with psychological disorders like autism spectrum disorders (ASDs), whereby emotional development becomes crucial. However, traditional paper-based interventions for emotional development are mostly laborious and difficult to employ for carers and parents, whilst current computer-aided interventions feel too much like obvious assistive tools and lack timely feedback to inform and aid progress. This paper hence describes the design of CopyMe, a touch-based tablet application that uses game design concepts and state-of-the-art computer vision techniques to provide an engaging experience as well as real-time feedback on the children's progress.

References

[1]

Battocchi, A., Pianesi, F., Tomasini, D., Zancanaro, M., Esposito, G., Venuti, P., Ben Sasson, A., Gal, E., and Weiss, P. L. 2009. Collaborative Puzzle Game: a tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD). In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ACM, New York, NY, USA, ITS '09, 197--204.

Digital Library

Google Scholar

[2]

Bons, D. M. A., Scheepers, F. E., Rommelse, N. N. J., and Buitelaar, J. K., 2010. Motor, emotional and cognitive empathic abilities in children with autism and conduct disorder.

Google Scholar

[3]

Elzouki, S. Y. A., Fabri, M., and Moore, D. J., 2007. Teaching severely autistic children to recognise emotions: finding a methodology.

Google Scholar

[4]

Gotsis, M., Piggot, J., Hughes, D., and Stone, W. 2010. SMART-games: a video game intervention for children with Autism Spectrum Disorders. In Proceedings of the 9th International Conference on Interaction Design and Children, ACM, New York, NY, USA, IDC '10, 194--197.

Digital Library

Google Scholar

[5]

Hailpern, J., Harris, A., Botz, R. L., Birman, B., and Karahalios, K., 2012. Designing visualizations to facilitate multisyllabic speech with children with autism and speech delays.

Google Scholar

[6]

Harrold, N., Tan, C. T., and Rosser, D. 2012. Towards an expression recognition game to assist the emotional development of children with autism spectrum disorders. In Proceedings of the Workshop at SIGGRAPH Asia on - WASA '12, ACM Press, New York, New York, USA, 33.

Digital Library

Google Scholar

[7]

Hayes, G. R., Hirano, S., Marcu, G., Monibi, M., Nguyen, D. H., and Yeganyan, M. 2010. Interactive visual supports for children with autism. Personal Ubiquitous Comput. 14, 7, 663--680.

Digital Library

Google Scholar

[8]

Mohammedali, M., Phung, D., Adams, B., and Venkatesh, S., 2011. A context-sensitive device to help people with autism cope with anxiety.

Google Scholar

[9]

Park, J. H., Abirached, B., and Zhang, Y., 2012. A framework for designing assistive technologies for teaching children with ASDs emotions.

Google Scholar

[10]

Saragih, J. M., Lucey, S., and Cohn, J. F. 2010. Deformable Model Fitting by Regularized Landmark Mean-Shift. International Journal of Computer Vision 91, 2 (Sept.), 200--215.

Digital Library

Google Scholar

Cited By

View all

Ahmed FBerta RBellotti FLazzaroni LFloris FBarresi GCarrion J(2023)Socio-Economic Decision Making and Emotion Elicitation with a Serious Game in the WildApplied Sciences10.3390/app1311643213:11(6432)Online publication date: 24-May-2023
https://doi.org/10.3390/app13116432
Wu JFan MSheng LSun G(2023)Exploring the design space of virtual tutors for children with autism spectrum disorderEducation and Information Technologies10.1007/s10639-023-11838-x28:12(16531-16560)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s10639-023-11838-x
Rocha MValentim PBarreto FMitjans ACruz-Sandoval DFavela JMuchaluat-Saade D(2022)Towards Enhancing the Multimodal Interaction of a Social Robot to Assist Children with Autism in Emotion RegulationPervasive Computing Technologies for Healthcare10.1007/978-3-030-99194-4_25(398-415)Online publication date: 23-Mar-2022
https://doi.org/10.1007/978-3-030-99194-4_25
Show More Cited By

Index Terms

Recommendations

CopyMe: an emotional development game for children
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Proper emotional development is important for young children, especially those with psychological disorders such as autism spectrum disorders (ASDs), whereby early intervention becomes crucial. However, traditional paper-based interventions are mostly ...
CopyMe: a portable real-time feedback expression recognition game for children
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Assistive tools are commonly used to aid children experiencing emotional developmental problems associated with psychological disorders, such as autism spectrum disorders (ASDs). In many cases early intervention is crucial to ease the struggle to ...
Can you CopyMe?: an expression mimicking serious game
SA '13: SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications

Emotional development is an important aspect in the early years of growth in young children, especially those with psychological disorders like autism spectrum disorders (ASDs), whereby emotional development becomes crucial. However, traditional paper-...

Comments

Information & Contributors

Information

Published In

SA '13: SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications

November 2013

90 pages

ISBN:9781450326339

DOI:10.1145/2543651

Conference Chairs:
Mark Billinghurst
University of Canterbury, New Zealand
,
Börje Karlsson
Microsoft Research Asia, China

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 November 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Faculty of Engineering & IT travel at the University of Technology, Sydney

Conference

SA '13

Sponsor:

SIGGRAPH

SA '13: SIGGRAPH Asia 2013

November 19 - 22, 2013

Hong Kong, Hong Kong

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
385
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ahmed FBerta RBellotti FLazzaroni LFloris FBarresi GCarrion J(2023)Socio-Economic Decision Making and Emotion Elicitation with a Serious Game in the WildApplied Sciences10.3390/app1311643213:11(6432)Online publication date: 24-May-2023
https://doi.org/10.3390/app13116432
Wu JFan MSheng LSun G(2023)Exploring the design space of virtual tutors for children with autism spectrum disorderEducation and Information Technologies10.1007/s10639-023-11838-x28:12(16531-16560)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s10639-023-11838-x
Rocha MValentim PBarreto FMitjans ACruz-Sandoval DFavela JMuchaluat-Saade D(2022)Towards Enhancing the Multimodal Interaction of a Social Robot to Assist Children with Autism in Emotion RegulationPervasive Computing Technologies for Healthcare10.1007/978-3-030-99194-4_25(398-415)Online publication date: 23-Mar-2022
https://doi.org/10.1007/978-3-030-99194-4_25
Park JLee SLee SRoussou MShahid SFails JLandoni M(2021)MODU: A Story-Based Empathy Expression Training Game for Children with Mild Intellectual Disability and Borderline Intellectual FunctioningProceedings of the 20th Annual ACM Interaction Design and Children Conference10.1145/3459990.3465205(615-619)Online publication date: 24-Jun-2021
https://dl.acm.org/doi/10.1145/3459990.3465205
Hassan APinkwart NShafi M(2021)Serious games to improve social and emotional intelligence in children with autismEntertainment Computing10.1016/j.entcom.2021.10041738(100417)Online publication date: May-2021
https://doi.org/10.1016/j.entcom.2021.100417
Robinson RWiley KRezaeivahdati AKlarkowski MMandryk RMirza-Babaei PMcArthur VVanden Abeele VBirk M(2020)"Let's Get Physiological, Physiological!"Proceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3410404.3414227(132-147)Online publication date: 2-Nov-2020
https://dl.acm.org/doi/10.1145/3410404.3414227
Dapogny AGrossard CHun SSerret SGrynszpan ODubuisson SCohen DBailly K(2019)On Automatically Assessing Children's Facial Expressions Quality: A Study, Database, and ProtocolFrontiers in Computer Science10.3389/fcomp.2019.000051Online publication date: 11-Oct-2019
https://doi.org/10.3389/fcomp.2019.00005
Tsikinas SXinogalos S(2019)Design Guidelines for Serious Games Targeted to People with AutismSmart Education and e-Learning 201910.1007/978-981-13-8260-4_43(489-499)Online publication date: 1-Jun-2019
https://doi.org/10.1007/978-981-13-8260-4_43
Camargo MBarros RBrancher JBarros VSantana M(2019)Designing Gamified Interventions for Autism Spectrum Disorder: A Systematic ReviewEntertainment Computing and Serious Games10.1007/978-3-030-34644-7_28(341-352)Online publication date: 4-Nov-2019
https://doi.org/10.1007/978-3-030-34644-7_28
Dapogny AGrossard CHun SSerret SBourgeois JJean-Marie HFoulon PDing HChen LDubuisson SGrynszpan OCohen DBailly K(2018)JEMImE: A Serious Game to Teach Children with ASD How to Adequately Produce Facial Expressions2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018)10.1109/FG.2018.00114(723-730)Online publication date: 15-May-2018
https://dl.acm.org/doi/10.1109/FG.2018.00114
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

CopyMe: an emotional development game for children

CopyMe: a portable real-time feedback expression recognition game for children

Can you CopyMe?: an expression mimicking serious game