research-article

Supporting collective physical activities by interactive floor projection in a special-needs school setting

Authors:

Shuichi Akizuki,

Baptiste Bourreau,

Issey Takahashi,

Yoshimitsu Aoki,

Junichi Yamamoto,

Kenji SuzukiAuthors Info & Claims

Volume 32, Issue C

https://doi.org/10.1016/j.ijcci.2021.100392

Published: 01 June 2022 Publication History

Abstract

This paper presents an algorithm to provide floor projection feedback according to the local distance and density of individuals. It is realized by a large-space floor projection system with a feedback function based on human tracking with laser ranging image sensors. The purpose is to support the cognition of spatial–temporal structures of groups of adolescents with neurodevelopmental disorders (NDs) that are conducting organized physical activity (PA). Observation and evaluation of behavioral changes in adolescents with NDs, when they were active with or without the floor projection based on the proposed algorithm, were conducted to validate its effectiveness. We observed that the proposed algorithm can be implemented in different organized PAs. It had the effect to help individuals in a behavior to keep a close distance to each other as a group rather than to keep the same distance apart from each other while walking.

References

[1]

American Psychiatric Association, Diagnostic and statistical manual of mental disorders (2013). (5th ed.) (DSM-5). Arlington, VA.

[2]

Arim R.G., Findlay L.C., Kohen D.E., Participation in physical activity for children with neurodevelopmental disorders, International Journal of Pediatrics 2012 (460384) (2012),.

[3]

Asada K., Tojo Y., Osanai H., Saito A., Hasegawa T., Kumagaya S., Reduced personal space in individuals with autism spectrum disorder, PLoS One 11 (1) (2016),.

[4]

Bewley A., Ge Z., Ott L., Ramos F., Upcroft B., Simple online and realtime tracking, in: IEEE intl conference on image processing (ICIP), 2016, pp. 3464–3468,.

[5]

Bryson S., Wainwright-Sharp J., Smith I.M., Autism: A developmental spatial neglect syndrome?, in: Enns J.T. (Ed.), Advances in psychology, 69. The development of attention: research and theory, Elsevier Science, 1990, pp. 405–427.

[6]

Chester V.L., Calhoun M., Gait symmetry in children with autism, Autism Research and Treatment 2012 (576478) (2012),.

[7]

Choi W., Savarese S., Understanding collective activities of people from videos, IEEE Transactions on Pattern Analysis and Machine Intelligence 36 (6) (2014) 1242–1257,.

Digital Library

[8]

Cibrian F.L., Ortega D.H., Escobedo L., Tentori M., Reflections from a long-term deployment study to design novel interactive surfaces for children with autism, in: Bravo J., Hervás R., Villarreal V. (Eds.), Ambient intelligence for health. AmIHEALTH 2015, in: Lecture notes in computer science, vol. 9456, 2015, pp. 167–176,.

[9]

Cibrian F.L., Tentori M., Martinez-Garcia A.I., Hunting relics: A persuasive exergame to promote collective exercise in young children, International Journal of Child-Computer Interaction 32 (3) (2016) 277–294,.

[10]

Coulter R.A., Understanding the visual symptoms of individuals with autism spectrum disorder (ASD), Optometry and Vision Development 40 (3) (2009) 164–175.

[11]

Donnellan A.M., Hill D.A., Leary M.R., Rethinking autism: implications of sensory and movement differences for understanding and support, Frontiers in Integrative Neuroscience 6 (124) (2012),.

[12]

ELAN (Version5.9) [Computer software]. (2020). Nijmegen: Max Planck Institute for Psycholinguistics, The Language Archive. Retrieved from https://archive.mpi.nl/tla/elan.

[13]

Fahle M., Poggio T., Perceptual learning, MIT Press, 2002.

[14]

Gabbard C.P., Lifelong motor development, Pearson Benjamin Cummings, San Francisco, CA, 2012.

[15]

Garzotto F., Gelsomini M., Magic Room: A smart space for children with neurodevelopmental disorder, IEEE Pervasive Computing 17 (1) (2018) 38–48,.

Digital Library

[16]

Gelsomini M., Leonardi G., Garzotto F., Embodied learning in immersive smart spaces, in: Proc. ACM SIGCHI’, vol. 20, 2020, pp. 1–14,.

Digital Library

[17]

Graf R., Benawri P., Whitesall A.E., Carichner D., Li Z., Nebeling M., et al., iGYM: An interactive floor projection system for inclusive exergame environments, CHI PLAY 19 (2019) 31–43,.

Digital Library

[18]

Greenspan S.I., Wieder S., Developmental patterns and outcomes in infants and children with disorders in relating and communicating: A chart review of 200 cases of children with autistic spectrum diagnoses, Journal of Developmental and Learning Disorders 1 (1997) 87–142.

[19]

Hoberman, P., Pares, N., & Pares, R. (1999). El Ball del Fanalet or Light-pools. In Proc. of intl conference on virtual systems and multimedia (VSMM’99) (pp. 270–276).

[20]

Johnson C.C., The benefits of physical activity for youth with developmental disabilities: a systematic review, American Journal of Health Promotion 23 (3) (2009) 157–167,.

[21]

Khowaja K., et al., Augmented reality for learning of children and adolescents with autism spectrum disorder (ASD): A systematic review, IEEE Access 8 (2020) 78779–78807,.

[22]

Kientz J.A., Hayes G.R., Goodwin M.S., Gelsomini M., Abowd G.D., Baecker R.M. (Ed.), Interactive technologies and autism, in: Synthesis lectures on assitive, rehabilitative, and health-preserving technologies, lecture #13, 2nd ed., Morgan and Claypool Publishers, 2020.

[23]

Klatzky R.L., Allocentric and egocentric spatial representations: definitions, distinctions, and interconnections, in: Freksa C., Habel C., Wender K.F. (Eds.), Spatial cognition, in: Lecture notes in computer science, Vol. 1404, Springer, Berlin, Heidelberg, 1998, pp. 1–17.

[24]

Kozlowski L.T., Bryant K.J., Sense of direction, spatial orientation, and cognitive maps, Journal of Experimental Psychology: Human Perception and Performance 3 (4) (1977) 590–598,.

[25]

Lancioni G.E., Cuvo A.J., O’Reilly M.F., Snoezelen: An overview of research with people with developmental disabilities and dementia, Disability and Rehabilitation 24 (4) (2002) 175–184,.

[26]

Malinverni L., Parés N., Learning from failures in designing and evaluating full-body interaction learning environments, in: Proc. ACM CHI EA’, vol. 17, 2018, pp. 1065–1074,.

Digital Library

[27]

Monastero B., McGookin D., Traces: Studying a public reactive floor-projection of walking trajectories to support social awareness, in: Proc. ACM SIGCHI’18, 2018, p. 487,.

Digital Library

[28]

Mora-guiard J., Crowell C., Parés N., Heaton P., Lands of Fog: Helping children with autism in social interaction through a full-body interactive experience, in: Proceedings of the 15th international conference on interaction design and children, 2016, pp. 262–274,.

Digital Library

[29]

Mora-guiard J., Crowell C., Parés N., Heaton P., Sparking social initiation behaviors in children with autism through full-body interaction, International Journal of Child-Computer Interaction 11 (2016) 62–71,.

[30]

Mueller F.F., Byrne R., Andres J., Patibanda R., Experiencing the body as play, in: Proc. of ACM SIGCHI’18, 2018, p. 210,.

Digital Library

[31]

Oki M., Bourreau B., Takahashi I., Suzuki K., CANVAS: A drawing tool for AR-aided special needs education using interactive floor projection, in: Proc. of IEEE SMC’, vol. 19, 2019, pp. 2639–2644,.

Digital Library

[32]

Olley G.J., Curriculum and classroom structure, in: Volkmar F.R., Paul R., Klin A., Cohen D. (Eds.), Handbook of autism and pervasive developmental disorders, John Wiley and Sons, New Jersey, 2005, pp. 863–881.

[33]

Parés N., Carreras A., Durany J., Ferrer J., Freixa P., Gómez D., et al., Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment, in: Proc. ACM IDC’, vol. 05, 2005, pp. 110–116,.

Digital Library

[34]

Parsons S., Learning to work together: Designing a multi-user virtual reality game for social collaboration and perspective-taking for children with autism, International Journal of Child-Computer Interaction 6 (2015) 28–38,.

Digital Library

[35]

Parsons S., Mitchell P., The potential of virtual reality in social skills training for people with autistic spectrum disorders, Journal of Intellectual Disability Research 46 (2002) 430–443,.

[36]

Phillips D., Hannon J.C., Molina S., Teaching spatial awareness in small-sided games, A Journal for Physical and Sport Educators 28 (2) (2015) 11–16,.

[37]

Pontifex M.B., Fine J.G., da Cruz K., Parks A.C., Smith A.L., The role of physical activity in reducing barriers to learning in children with developmental disorders, Monographs of the Society for Research in Child Development 79 (4) (2014) 93–118,.

[38]

Quill K.A., Visually cued instruction for children with autism and pervasive developmental disorders, Focus on Autistic Behavior 10 (3) (1995) 10–20,.

[39]

Redmon J., Farhadi A., YOLOV3: An incremental improvement, 2018, arXiv:1804.02767.

[40]

Ren S., He K., Girshick R., Sun J., Faster R-CNN: Towards real-time object detection with region proposal networks, in: NIPS’15: Proceedings of the 28th international conference on neural information processing systems, 2015, pp. 91–99. arXiv:1506.01497.

[41]

Ringland K.E., Zalapa R., Neal M., Escobedo L., Tentori M., Hayes G.R., SensoryPaint: A multimodal sensory intervention for children with neurodevelopmental disorders, in: Proc. ACM Ubicomp, 2014, pp. 873–884,.

Digital Library

[42]

Sharmin M., Hossain M.M., Saha A., Das M., Maxwell M., Ahmed S., From research to practice: Informing the design of autism support smart technology, in: Proc. ACM CHI’18, vol. 102, 2018, pp. 1–16,.

Digital Library

[43]

Siegl C., Lange V., Stamminger M., Bauer F., Thies J., FaceForge: Markerless non-rigid face multi-projection mapping, IEEE Transactions on Visualization & Computer Graphics 23 (11) (2017) 2440–2446,.

Digital Library

[44]

Takahashi I., Oki M., Bourreau B., Kitahara I., Suzuki K., Designing interactive visual supports for children with special needs in a school setting, in: Proc. of DIS’18, 2018, pp. 265–275,.

Digital Library

[45]

Takahashi I., Oki M., Bourreau B., Kitahara I., Suzuki K., An empathic design approach to an augmented gymnasium in a special needs school setting, International Journal of Design 12 (3) (2018) 111–125.

[46]

Takahashi I., Oki M., Bourreau B., Kitahara I., Suzuki K., FUTUREGYM: A gymnasium with interactive floor projection for children with special needs, International Journal of Child-Computer Interaction 15 (2018) 37–47,.

[47]

Taub D.E., Greer K.R., Physical activity as a normalizing experience for school-age children with physical disabilities. Implications for legitimation of social identity and enhancement of social ties, Journal of Sport and Social Issues 24 (4) (2000) 395–414,.

[48]

Tayla A., April B., Kirsten D., Jeanette G., Physical activity interventions for children with social, emotional, and behavioral disabilities – A systematic review, Journal of Developmental & Behavioral Pediatrics 38 (6) (2017) 431–445,.

[49]

Thapar A., Cooper M., Rutter M., Neurodevelopmental disorders, Lancet Psychiatry 4 (4) (2017) 339–346,.

[50]

Tissot C., Evans R., Visual teaching strategies for children with autism, Early Child Development and Care 173 (4) (2003) 425–433,.

[51]

Wilson M., Six views of embodied cognition, Psychonomic Bulletin & Review 9 (4) (2002) 625–636,.

[52]

Zhou Y., Xiao S., Tang N., Wei Z., Chen X., Pmomo: Projection mapping on movable 3D object, in: Proc. ACM CHI’, vol. 16, 2016, pp. 781–790,.

Digital Library

Cited By

Nebeling MOki MGelsomini MHayes GBillinghurst MSuzuki KGraf R(2024)Designing Inclusive Future Augmented RealitiesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636313(1-6)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636313

Index Terms

Supporting collective physical activities by interactive floor projection in a special-needs school setting
1. Applied computing
2. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Interactive soft toys to support social engagement through sensory-motor plays in early intervention of kids with special needs
IDC '22: Proceedings of the 21st Annual ACM Interaction Design and Children Conference

Transitional Wearable Companion (TWC) is a novel design concept, implemented as an interactive, smart, soft toy, which aims to stimulate curiosity and encourage social engagement in kids with special needs, during play activities with their caregivers. ...
CHIMELIGHT: Augmenting Instruments in Interactive Music Therapy for Children with Neurodevelopmental Disorders
ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

In this paper, we propose a new mobile system to support therapists for teaching and tracking socio-communicative behaviors in children with neurodevelopmental disorders during music therapy sessions. The CHIMELIGHT system was designed to deal with the ...
Move&Learn: an Adaptive Exergame to Support Visual-Motor Skills of Children with Neurodevelopmental Disorders
GoodIT '21: Proceedings of the Conference on Information Technology for Social Good

Several neurodevelopmental disorders, such as autism spectrum disorder (ASD), attention-deficit/hyperactivity disorder (ADHD), and intellectual developmental disorders (including Down syndrome), are characterized by deficits in motor coordination, ...

Comments

Information & Contributors

Information

Published In

cover image International Journal of Child-Computer Interaction

International Journal of Child-Computer Interaction Volume 32, Issue C

Jun 2022

260 pages

ISSN:2212-8689

EISSN:2212-8689

Issue’s Table of Contents

The Authors.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 June 2022

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nebeling MOki MGelsomini MHayes GBillinghurst MSuzuki KGraf R(2024)Designing Inclusive Future Augmented RealitiesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636313(1-6)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636313

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents