extended-abstract

OSMoSIS: interactive sound generation system for children with autism

Authors:

Katherine HowlandAuthors Info & Claims

IDC '20: Proceedings of the 2020 ACM Interaction Design and Children Conference: Extended Abstracts

Pages 151 - 156

https://doi.org/10.1145/3397617.3397838

Published: 21 July 2020 Publication History

Abstract

This paper reports on the design and pilot evaluation of a system that uses movement, music and sounds to support playful interactions for children with Autism Spectrum Conditions (ASC). OSMoSIS (Observation of Social Motor Synchrony with an Interactive System) is a musical motion-based game. The design was inspired by previous research that suggests that music and movement can be helpful in fostering communication and expression skills, and the first author's experiences as a music therapist. OSMoSIS converts movements into sounds, using a Microsoft Kinect-based system which provides full body tracking. A recently conducted evaluation with a group of 11 children with autism aged 5-- 11 years old showed positive engagement with the system, and some instances of imaginative play. In our discussion, we highlight implications for the design of future music and movement systems to support learning in children with autism.

References

[1]

American Psychiatric Publishing. American Psychiatric Association. 2013. Diagnostic and Statistical Manual of Mental Disorders. American Psychiatric Publishing

[2]

Cibrian, F.L. et al., 2017 BendableSound: An elastic multisensory surface using touch-based interactions to assist children with severe autism during music therapy. Int J Hum-CompStudies. 107, May (2017), 22--37.

Digital Library

[3]

Colombo Dougovito, M., Block, M. E., 2017. Fundamental Motor Skill Interventions for Children and Adolescents on the Autism Spectrum: a Literature Review. Journal of Autism and Developmental Disorders volume 6, 159--171(2019)

[4]

Frid, E., Breson, R., (2016) Interactive Sonificationof Spontaneous Movement of Children-Cross-Modal aping and the Perception of Body Movement Qualities through Sound. Frontiers in Neuroscience. 10, November (2016)

[5]

Fournier, K.A., 2010, Motor coordination in autism spectrum disorders: a synthesis and meta-analysis, Journal Autism Developmenytal Disorder.

[6]

Herrera, G., (2012), Pictogram Room: Natural Interaction Technologies to Aid in the Development of Children with Autism, ResearchGate.

[7]

Hossein H., M., Khademi, M., 2016, A Review on Technical and Clinical Impact of Microsoft Kinect on Physical Therapy and Rehabilitation, Journal of Medical Engineering.

[8]

James, R., 2015. Music Therapy for Individuals with Autism Spectrum Disorder: a Systematic Review. Review Journal of Autism and Developmental Disorders. 2, 1, 39 -- 54.

[9]

Leekam, S., (2016), Social cognitive impairment and autism: what are we trying to explain? Philosophical Transactions of the Royal Society B: Biological Sciences, 19 January, 371(1686).

[10]

Magee, W.L., 2006, Electronic technologies in clinical music therapy: a survey of practice and attitudes. Technology and Disability, 18(3), 139--146.

[11]

Marco E. J., (2012). Children with autism show reduced somatosensory response: a MEG study. Autism Res. 5, 340--351.

[12]

Ragone G., 2017. Sketchpad, a Man-Machine Graphical Communication System. Master Dissertation. University of Sussex, Brighton, UK.

[13]

Ramseyer, F. T. (2019). Motion Energy Analysis (MEA). A primer on the assessment of motion from video. Journal of Counseling Psychology.

[14]

Sharda, M., 2018, Music improves social communication and auditory-motor connectivity in children with autism. Translational Psychiatry, 8, 1. 1--13.

[15]

Sigrist, R., et al., 2014. Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning. Experimental Brain Research. 233, 3 (2014), 909--925.

[16]

Teitelbaum, P., 1998, Movement analysis in infancy may be useful for early diagnosis of autism, Proceedings of the National Academy of Sciences of the United States of America, 95, 23, pag. 13982--13987, November 1998.

Cited By

Nunes CDarin T(2024)Echoes of Player Experience: A Literature Review on Audio Assessment and Player Experience in GamesProceedings of the ACM on Human-Computer Interaction10.1145/36770698:CHI PLAY(1-27)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677069
Ragone GGood JHowland KDu Boulay B(2024)Enhancing Assessment of Social Motor Synchrony Through Full-Body Interaction: A Novel Approach with OSMoSIS ToolProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659388(749-753)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659388
Dobesh SAlbert JAhmed SSharmin M(2023)Moving Towards an Accessible Approach to Music Therapy for Autistic People: A Systematic Review2023 IEEE 47th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC57700.2023.00069(472-480)Online publication date: Jun-2023
https://doi.org/10.1109/COMPSAC57700.2023.00069
Show More Cited By

Index Terms

OSMoSIS: interactive sound generation system for children with autism
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies

Recommendations

The Need for Smart Parenting Module for Parenting Self-Efficacy of Parents with Autism Children During Covid-19 Pandemic
ICLIQE '21: Proceedings of the 5th International Conference on Learning Innovation and Quality Education

During the COVID-19 pandemic, the role of parents in assisting and educating children with autism is limited to their ability and knowledge of how to educate children with autism, parents with low parenting self-efficacy should work hard to meet the ...
Which Virtual Piano Keyboard for Children with Autism? A Pilot Study
HCI International 2019 – Late Breaking Papers
Abstract
Music can be a powerful therapy for many conditions, including autism syndrome. Technology is usually intrinsically attractive for children with autism, who often interact with apps on tablets and smartphones. It can offer structured, repeatable, ...
The STORM Project: Using Video Game to Promote Completion of Morning Routine for Children with Attention Deficit Hyperactivity Disorder and Autism Spectrum Disorder
Universal Access in Human-Computer Interaction. Applications and Practice
Abstract
Morning routines can be challenging for children with Attention Deficit Hyperactivity Disorder (ADHD) or Autism Spectrum Disorder (ASD) [1, 2]. To support their children, parents must use daily monitoring and frequent reinforcement that can be ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IDC '20: Proceedings of the 2020 ACM Interaction Design and Children Conference: Extended Abstracts

June 2020

367 pages

ISBN:9781450380201

DOI:10.1145/3397617

General Chairs:
Elisa Rubegni
University of Lancaster, UK
,
Asimina Vasalou
University College London, UK
,
Program Chairs:
Narcís Parés
Universitat Pompeu Fabra, Spain
,
Nitin Sawhney
Aalto University, Finland

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2020

Check for updates

Badges

Best Poster

Author Tags

Qualifiers

Extended-abstract

Conference

IDC '20

Sponsor:

SIGCHI

IDC '20: Interaction Design and Children

June 21 - 24, 2020

London, United Kingdom

Acceptance Rates

Overall Acceptance Rate 172 of 578 submissions, 30%

Upcoming Conference

IDC '25

Sponsor:
sigchi

Interaction Design and Children

June 23 - 26, 2025

Reykjavik , Iceland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
187
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nunes CDarin T(2024)Echoes of Player Experience: A Literature Review on Audio Assessment and Player Experience in GamesProceedings of the ACM on Human-Computer Interaction10.1145/36770698:CHI PLAY(1-27)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677069
Ragone GGood JHowland KDu Boulay B(2024)Enhancing Assessment of Social Motor Synchrony Through Full-Body Interaction: A Novel Approach with OSMoSIS ToolProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659388(749-753)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659388
Dobesh SAlbert JAhmed SSharmin M(2023)Moving Towards an Accessible Approach to Music Therapy for Autistic People: A Systematic Review2023 IEEE 47th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC57700.2023.00069(472-480)Online publication date: Jun-2023
https://doi.org/10.1109/COMPSAC57700.2023.00069
Johansen Svan Berkel NFritsch J(2022)Characterising Soundscape Research in Human-Computer InteractionProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533458(1394-1417)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533458
Ragone GHowland KBrulé E(2022)Evaluating Interactional Synchrony in Full-Body Interaction with Autistic ChildrenProceedings of the 21st Annual ACM Interaction Design and Children Conference10.1145/3501712.3529729(1-12)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3501712.3529729
Ragone GGood JHowland K(2021)How Technology Applied to Music-Therapy and Sound-Based Activities Addresses Motor and Social Skills in Autistic ChildrenMultimodal Technologies and Interaction10.3390/mti50300115:3(11)Online publication date: 5-Mar-2021
https://doi.org/10.3390/mti5030011
Yuill NYuill N(2021)Autism and Technology for CollaborationTechnology to Support Children's Collaborative Interactions10.1007/978-3-030-75047-3_6(105-126)Online publication date: 7-Sep-2021
https://doi.org/10.1007/978-3-030-75047-3_6

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten